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SUMMARY 


A  growing  number  of  states  are  implementing  standards-based  school  accountability 
systems  in  efforts  to  improve  student  achievement.  Washington  state's  Education  Reform  Act  is 
an  example  of  such  a  reform.  It  mandated  the  creation  of  academic  standards,  called  the 
Essential  Academic  Learning  Requirements  (EALRs),  a  state  assessment  system,  called  the 
Washington  Assessment  of  Student  Learning  (WASL),  and  an  accountability  mechanism,  which 
is  still  under  development.  One  feature  that  sets  Washington  apart  from  other  states  that 
implemented  similar  systems  is  that  Washington  policymakers  have  adopted  a  gradual  approach 
to  implementation,  bringing  new  subjects  into  the  assessment  system  on  an  incremental  basis 
over  the  period  of  a  decade. 

Researchers  from  RAND  and  the  University  of  Colorado,  Boulder  are  studying  the 
implementation  and  impact  of  the  Washington  reform  on  school  and  classroom  practices, 
focusing  on  the  subjects  of  writing  and  mathematics.  In  1998-99,  surveys  were  sent  to  a 
representative  sample  of  about  150  elementary  and  middle  school  principals  and  a  representative 
sample  of  about  400  writing  and  mathematics  teachers  in  fourth  and  seventh  grades.  These  are 
the  grades  in  which  students  take  the  WASL  tests.  The  surveys  asked  about  the  respondents’ 
familiarity  with  the  reform  and  their  opinions  about  it.  Principals  were  also  asked  about 
implementation  of  the  reform  at  the  district  and  school  levels,  including  changes  to  standards, 
curriculum  and  assessments.  Teachers  were  also  asked  about  their  participation  in  professional 
development  and  changes  in  their  classroom  practices  in  writing  and  mathematics. 

The  surveys  revealed  a  picture  of  districts  and  schools  in  transition,  with  many  changes 
occurring  but  always  not  uniformly  across  classrooms  or  schools.  Principals  and  teachers  in 
Washington  have  spent  a  great  deal  of  time  learning  about  the  reform,  and  they  believed  they 
understood  its  key  components  well.  In  general,  they  believed  the  standards  were  appropriate 
and  attainable.  At  the  district  level,  steps  were  being  taken  to  align  curriculum  and  assessment 
with  the  state  system.  Schools  and  teachers  were  also  working  to  make  their  programs  consistent 
with  the  direction  set  by  the  state.  Teachers  were  changing  classroom  curriculum  and  instruction 
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in  response  to  the  reform.  Not  all  aspects  of  the  reform  were  equally  salient,  however.  In 
general,  classroom  changes  appeared  to  be  consistent  with  the  EALRs,  although  local  educators 
appeared  to  be  responding  most  to  the  highly- visible  WASL  scores  and  making  curriculum 
changes  primarily  in  the  WASL-tested  subjects.  Classroom-based  assessment,  in  particular,  was 
not  as  widely  understood  or  endorsed  as  the  EALRs  and  WASL. 

There  were  also  a  few  differences  between  groups  of  educators  that  are  worthy  of 
attention.  Principals  had  a  greater  understanding  of  the  reform  than  teachers,  and  they  were 
more  positive  about  its  basic  goals.  Teachers’  responses  varied  somewhat  across  subjects  and 
grade  levels;  mathematics  teachers  made  more  changes  to  classroom  practice  than  writing 
teachers,  and  elementary  school  teachers  made  greater  changes  than  middle  school  teachers. 

Finally,  the  survey  responses  paint  a  mixed  picture  about  the  relationship  between  school 
practices  and  WASL  scores.  On  the  one  hand,  after  controlling  for  student  background  factors, 
WASL  scores  were  higher  in  schools  where  teachers  reported  alignment  between  their 
curriculum  and  the  EALRS  and  (to  a  lesser  extent)  where  teachers  reported  that  they  understood 
the  EALRs  and  WASL.  On  the  other  hand,  some  of  the  responses  raised  questions  about  the 
meaningfulness  of  WASL  scores  and  score  gains  as  indicators  of  attainment  of  the  standards. 
Most  teachers  believed  that  test  preparation  was  responsible  for  the  majority  of  score  gains. 
Many  teachers  thought  that  the  WASL  was  not  appropriate  for  the  grade  levels  at  which  it  was 
administered.  These  issues  deserve  further  scrutiny  as  the  accountability  system  is  developed. 
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BACKGROUND  AND  PURPOSE 

In  1995,  researchers  at  RAND  and  the  University  of  Colorado,  Boulder  (CU  Boulder) 
began  a  program  of  research  on  the  impact  of  standards-based,  test-driven  reforms  on  school  and 
classroom  practices.  These  studies,  which  were  conducted  under  the  auspices  of  the  Center  for 
Research  on  Evaluation,  Standards,  and  Student  Testing  (CRESST),  included  both  statewide 
surveys  of  principals  and  teachers  and  case  studies  of  carefully  selected,  exemplary  teachers. 

The  research  design  called  for  conducting  similar  investigations  sequentially  in  two  states,  one 
that  was  an  “early  implementer”  of  standards-based  reform,  and  one  that  initiated  such  reforms  at 
a  later  time.  Kentucky  was  selected  as  the  first  state,  and  the  RAND  and  CU  Boulder  teams 
conducted  research  there  from  1995  to  1998.  Washington  was  selected  as  the  second  state,  and 
similar  research  began  there  in  1998.  This  report  presents  the  results  of  principal  and  teacher 
surveys  conducted  in  Washington  in  the  spring  of  1999.  Case  study  results  will  be  reported 
separately. 

Results  of  Prior  Research 

Research  in  Kentucky  indicates  that  standards-based  reforms  that  include  high  stakes 
testing  can  be  powerful  tools  to  change  what  is  happening  in  schools  and  classrooms  (Barron  and 
Stecher,  1999;  Borko  and  Elliott,  1998;  Borko  and  Elliott,  1999;  Stecher,  Barron,  Kaganoff  and 
Goodwin,  1998;  Stecher  and  Barron,  1999;  Mclver  and  Wolf,  1999;  Wolf  and  Mclver,  1999).  At 
the  time  of  the  research,  Kentucky  tested  students  on  reading,  writing  and  science  in  grades  four, 
seven  and  eleven  and  on  mathematics,  social  studies,  arts  and  humanities,  and  practical 
living/vocational  education  in  grades  five,  eight  and  eleven. 

The  state  hoped  to  drive  instruction  in  particular  directions  by  basing  the  assessment 
system  (KIRIS)  on  open-response  questions  and  portfolios  rather  than  multiple-choice  questions. 
The  research  found  that  the  Kentucky  education  reform,  which  included  new  standards  and 
performance  assessments  (KIRIS),  influenced  classroom  practices  in  both  elementary  and  middle 
schools.  The  project  found  evidence  of  increased  professional  development  related  to  the  tests 
and  the  standards,  increased  coverage  of  the  subjects  tested  by  KIRIS,  and  increased  frequency 
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of  standards-based  practices.  For  example,  two-thirds  of  fifth  grade  teachers  reported  increasing 
the  time  they  spent  on  mathematics,  and  the  greatest  increases  were  in  the  areas  of  mathematics 
emphasized  by  the  standards:  geometry  and  measurement,  statistics  and  probability,  and 
algebraic  ideas.  Similarly,  teachers  increased  their  attention  to  problem  solving  and 
mathematical  communication. 

However,  we  found  no  evidence  of  associations  between  practices  and  increased  KIRIS 
scores.  In  addition,  teachers  appeared  to  focus  more  on  the  tests  than  on  the  standards  the  tests 
were  supposed  to  represent.  One  consequence  of  such  “teaching  to  the  test”  was  that  curriculum 
coverage  varied  significantly  from  one  grade  to  the  next  in  parallel  with  the  subject  matter 
emphasis  of  KIRIS.  For  example,  students  in  fourth  and  seventh  grades  received  more 
instruction  in  reading,  writing  and  science,  while  students  in  fifth  and  eighth  grade  received  more 
instruction  in  mathematics,  social  studies,  and  arts/humanities.  Furthermore,  the  use  of 
performance  assessments  that  more  fully  represented  the  domains  of  interest,  had  mixed  effects, 
as  well.  For  example,  to  promote  writing  about  mathematics,  fifth  grade  teachers  increased  the 
amount  of  time  students  spent  on  mathematics  at  the  expense  of  time  spent  on  other  subjects 
such  as  science.  Similar  shifts  in  emphasis  occurred  within  specific  subject  areas.  For  example, 
the  KIRIS  writing  test  focuses  on  short  written  pieces,  and  teachers  focused  on  that  type  of 
writing  at  the  expense  of  other  types  of  writing. 

The  case  studies  focused  on  a  dozen  teachers  whose  mathematics  and  writing  instruction 
was  deemed  by  others  to  be  exemplary  (Borko  and  Elliott,  1998;  Borko  and  Elliott,  1999;  Mclver 
and  Wolf,  1999;  Wolf  and  Mclver, 1999).  Observations  and  interviews  were  used  to  identify 
features  of  reform  that  supported  such  exceptional  practice,  e.g.,  an  extensive  network  of 
professional  development  opportunities  and  a  belief  at  the  school  level  of  the  importance  of 
ongoing  support  for  teacher  learning.  They  also  identified  elements  of  the  accountability  system 
that  frustrated  even  the  best  teachers.  For  example,  fifth  grade  teachers  reorganized  their 
mathematics  curriculum  against  their  better  judgment  in  order  to  produce  enough  pieces  to 
complete  students’  mathematics  portfolios  by  the  required  date. 


2 


Current  Study 

In  1998  we  began  conducting  similar  investigations  in  Washington  focusing  on  grades 
four  and  seven,  which  are  the  elementary  and  middle  school  grades  at  which  the  WASL  tests  are 
administered.  We  adapted  the  surveys  used  in  Kentucky  to  reflect  the  structure  of  the 
Washington  education  reform.  In  some  cases  this  involved  merely  changing  terminology  and 
retaining  the  fundamental  framework  of  the  questions.  In  other  cases  where  the  conditions  in  the 
two  states  were  substantially  different,  it  required  developing  whole  new  items.  Separate 
surveys  for  principals  and  teachers  were  drafted,  field  tested  and  revised  during  the  fall  of  1998 
and  the  winter  of  1999.  The  final  surveys  were  administered  to  a  representative  sample  of 
elementary  and  middle  school  principals  and  teachers  in  grade  four  and  seven  in  the  spring  of 
1999.  Data  were  tabulated  and  analyzed  in  the  summer  and  fall,  and  the  results  are  presented 
here. 

In  1999-2000,  as  the  Washington  reform  is  more  fully  implemented,  we  will  conduct  a 
similar  set  of  surveys  focused  on  changes  in  practice.  The  goal  of  these  efforts  will  be  to 
determine  if  elementary  and  middle  school  principals  and  if  fourth  and  seventh  grade  teachers 
are  adapting  their  practices  as  they  become  more  familiar  with  the  standards  and  assessments  and 
as  the  accountability  system  moves  closer  to  completion.  We  will  also  compare  results  from  the 
two  states  to  see  if  differences  in  the  structure  of  the  programs  or  implementation  strategies  are 
associated  with  differences  in  their  impact  on  practice. 

Organization  of  the  Report 

The  remainder  of  the  report  is  organized  in  six  sections.  The  first  section  provides 
background  information  about  the  Washington  education  reform  for  readers  who  are  unfamiliar 
with  the  state's  standards,  assessments  and  plans  for  accountability.  The  second  section 
describes  our  research  methods.  The  third  section  presents  results  from  principals,  focusing  on 
administrative  changes.  The  next  section  describes  the  results  from  teachers.  Teacher  responses 
are  ordered  thematically  around  the  topics  of  preparation  for  and  implementation  of  the  reform, 
the  impact  of  the  reform  on  instruction  in  writing,  and  the  impact  on  instruction  in  mathematics. 
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Where  appropriate,  we  separate  the  responses  from  fourth  grade  teachers  (who  were  responsible 
for  both  writing  and  mathematics  instruction),  seventh  grade  writing  teachers  and  seventh  grade 
mathematics  teachers.  The  fifth  section  examines  the  relationship  between  survey  responses  and 
WASL  scores.  The  final  section  is  a  discussion  of  the  implications  of  these  data  for  education 
reform  in  Washington  and  elsewhere. 
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WASHINGTON  EDUCATION  REFORM 

In  1992,  the  Washington  legislature  created  the  Commission  on  Student  Learning  (CSL), 
with  responsibility  for  developing  a  standards-based  accountability  system  for  the  state 
(SSB5953).  The  CSL  was  asked  to  develop  content  standards,  create  appropriate  assessments, 
and  recommend  an  accountability  system  to  monitor  each  school’s  progress  in  achieving  the 
standards.  The  commission's  work  ultimately  led  to  the  Student  Learning  and  Improvement  Act 
(ESHB  1209),  which  the  legislature  passed  in  1993;  this  is  now  known  as  the  Education  Reform 
Act.  The  legislature  provided  $75  million  in  funding  to  support  the  Education  Reform  Act 
during  its  first  two  years,  the  largest  such  educational  expenditure  in  the  state’s  history  (CPRE 
State  Profile,  1996). 

The  Education  Reform  Act  declares  that  improving  student  achievement  will  require: 

1.  Establishing  what  is  expected  of  students,  with  standards  set  at  internationally 
competitive  levels; 

2.  Parents  to  be  primary  partners  in  the  education  of  their  children  and  to  play  a 
significantly  greater  role  in  local  school  decision  making; 

3.  Students  taking  more  responsibility  for  their  education; 

4.  Time  and  resources  for  educators  to  collaboratively  develop  and  implement  strategies  for 
improved  student  learning; 

5.  Making  instructional  programs  more  relevant  to  students'  future  plans; 

6.  All  parties  responsible  for  education  to  focus  more  on  what  is  best  for  students;  and 

7.  An  educational  environment  that  fosters  mutually  respectful  interactions  in  an 
atmosphere  of  collaboration  and  cooperation  (Bergeson,  Yoshitomi,  and  Butts,  1999;  p. 
3). 

Washington’s  education  reform  is  similar  to  standards-based  accountability  systems  in 
other  states  that  have  three  major  components:  a  set  of  standards,  measures  of  student 
performance,  and  a  system  of  incentives  for  improvement  (Education  Week,  1997;  Education 
Week,  1999).  Washington’s  system  includes  statewide  standards  for  what  students  should  know 
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and  be  able  to  do,  called  the  Essential  Academic  Learning  Requirements  (EALRs),  tests  to 
evaluate  student  knowledge  and  progress  towards  standards,  called  the  Washington  Assessment 
of  Student  Learning  (WASL),  and  an  as-yet-to-be-developed  mechanism  to  hold  schools 
accountable  for  student  performance.  The  WASL  assessments  include  both  multiple-choice  and 
open-response  measures  in  roughly  equal  proportions.  Another  distinguishing  feature  of  the 
reform  is  that  Washington  is  implementing  it  gradually  over  a  decade,  beginning  with  the  setting 
of  standards,  proceeding  to  the  gradual  introduction  of  assessments,  and  finally  the  development 
of  an  accountability  system  that  addresses  goals,  progress,  and  consequences  for  schools. 
Standards 

The  1993  legislation  established  four  basic  education  goals  for  students.  All  students 

shall: 

1.  Read  with  comprehension,  write  with  skill,  and  communicate  effectively  and 
responsibly  in  a  variety  of  ways  and  settings; 

2.  Know  and  apply  the  core  concepts  and  principles  of  mathematics;  social,  physical  and 
life  sciences;  civics  and  history;  geography;  arts;  and  health  and  fitness; 

3.  Think  analytically,  logically,  and  creatively,  and  integrate  experience  and  knowledge 
to  form  reasoned  judgements  and  solve  problems; 

4.  Understand  the  importance  of  work  and  how  performance,  effort,  and  decisions  affect 
future  career  and  educational  opportunities. 

Building  upon  these  basic  education  goals,  the  legislation  also  mandated  the  development 
of  more  specific  standards  for  academic  and  technical  skills  and  knowledge.  To  this  end,  the 
Commission  on  Student  Learning  (CSL)  established  EALRs  in  eight  content  areas:  reading, 
writing,  mathematics,  listening/communication,  science,  social  studies,  health/fitness,  and  the 
arts.  In  addition,  they  designated  three  benchmark  grades  at  which  performance  was  to  be 
assessed:  fourth  grade  (elementary),  seventh  grade  (middle  school)  and  tenth  grade  (high  school). 

The  EALRs  themselves  are  written  at  a  relatively  high  level  of  generality.  For  each 
subject  there  are  three  to  five  broad  performance  standards.  Table  1  contains  the  broad  standards 
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for  writing  and  mathematics.  Each  standard  is  elaborated  by  descriptions  of  general  student 
behaviors  that  would  demonstrate  mastery  of  the  standard.  Table  2  illustrates  the  descriptions  of 
student  behaviors  that  accompany  the  first  standards  in  writing  and  mathematics.  In  addition,  for 
each  behavior  there  are  more  detailed  benchmarks  describing  behaviors  that  would  be  expected 
for  students  in  grades  4, 7  and  10.  Examples  of  the  benchmarks  for  the  first  writing  and 
mathematics  standards  are  contained  in  Appendices  A  and  B,  respectively. 

Table  1 

EALR  Standards  in  Writing  and  Mathematics 


_ Writing _ 

1.  The  student  writes  clearly  and  effectively. 

2.  The  student  writes  in  a  variety  of  forms  for 
different  audiences  and  purposes. 

3.  The  students  understands  and  uses  steps  of 
the  writing  process. 

4.  The  student  analyzes  and  evaluates  the 
effectiveness  of  written  work 


_ Mathematics _ 

1.  The  student  understands  and  applies  the 
concepts  and  procedures  of  mathematics. 

2.  The  student  uses  mathematics  to  define  and 
solve  problems. 

3.  The  student  uses  mathematical  reasoning. 

4.  The  student  communicates  knowledge  and 
understanding  in  both  everyday  and 
mathematical  language. 

5.  The  students  understands  how  mathematical 
ideas  connect  within  mathematics,  to  other 
subject  areas,  and  to  real-life  situations. 


Assessments 

Many  changes  were  made  in  the  state  assessment  system  as  part  of  the  education  reform. 
The  cornerstone  of  the  new  system  is  the  Washington  Assessment  of  Student  Learning  (WASL), 
which  was  developed  specifically  for  the  state  by  a  commercial  contractor.  The  test  includes 
several  different  types  of  items  designed  to  measure  student  performance  and  progress  towards 
the  standards.  In  the  areas  of  reading,  mathematics,  and  listening,  students  answer  multiple- 
choice,  short-answer,  and  extended  response  questions.  In  writing,  students  are  required  to  write 
essays  in  response  to  specific  prompts.  All  WASL  assessments  are  untimed,  and 
accommodations  are  made  for  students  with  special  needs. 

In  addition  to  the  WASL,  the  state  also  administers  norm-referenced  standardized  tests  at 
selected  grade  levels.  The  state  recently  changed  standardized  tests,  adopting  the  Iowa  Tests  of 
Basic  Skills  (ITBS),  and  the  Iowa  Tests  of  Educational  Development  (ITED).  At  the  time  of  this 
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survey,  these  tests  were  administered  in  grades  3  and  8  in  the  subjects  of  reading  and 
mathematics,  and  in  grade  1 1  in  the  subjects  of  reading,  language  arts  and  mathematics. 
Beginning  in  1999-2000,  the  tests  will  be  administered  in  grades  3, 6  and  9.  Most  school 
districts  also  administer  other  exams  in  addition  to  those  required  by  the  state. 

Table  2 

EALR  Details  in  Writing  and  Mathematics 


The  student  understands  and  applies  the 

The  student  writes  clearly  and  effectively _ concepts  and  procedures  of  mathematics 

To  meet  this  standard,  the  student  will:  To  meet  this  standard  the  student  will: 


1.1  develop  concept  and  design  (develop  a 
topic  or  theme;  organize  written  thoughts 
with  a  clear  beginning,  middle  and  end;  use 
transitional  sentences  and  phrases  to 
connect  related  ideas;  write  coherently  and 
effectively) 

1.2  use  style  appropriate  to  the  audience  and 
purpose  (use  voice,  word  choice,  and 
sentence  fluency  for  intended  style  and 
audience) 

1.3  apply  writing  conventions  (know  and  apply 
correct  spelling,  grammar,  sentence 
structure,  punctuation,  and  capitalization) 


1.1  understand  and  apply  concepts  and 

procedures  from  number  sense  (number  and 
numeration,  computation,  and  estimation) 


1.2  understand  and  apply  concepts  and 
procedures  from  measurement  (attributes 
and  dimensions,  approximation  and 
precision,  and  systems  and  tools) 

1.3  understand  and  apply  concepts  and 
procedures  from  geometric  sense  (shape  and 
dimension,  and  relationships  and 
transformations) 

1.4  understand  and  apply  concepts  and 
procedures  from  probability  and  statistics 
(probability,  statistics,  and  prediction  and 
inference) 

1.5  understand  and  apply  concepts  and 

procedures  from  algebraic  sense  (relations 
and  representations,  and  operations) _ 


Classroom-based  assessments  (CBA)  are  another  element  of  the  state  assessment  system. 
The  state  has  developed  materials  and  provided  some  funds  to  schools  to  support  improved 
classroom  assessments  related  to  the  WASL.  Emphasis  has  been  given  to  performance-based 
measures,  which  may  include  examples  of  student  work,  such  as  experiments  or  projects,  or 
information  provided  through  oral  interviews  or  presentations.  The  goal  of  classroom-based 
assessments  is  to  help  teachers  respond  to  individual  students’  strengths  and  weaknesses,  some 
of  which  may  be  difficult  to  assess  with  the  WASL.  The  state  believes  that  CBA  is  an  essential 
component  of  a  good  instructional  program  because  such  assessments  “can  be  tailored  to  the 
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varying  developmental  needs  and  learning  styles  of  students.  Classroom-based  assessments, 
along  with  regular  exams,  quizzes  and  projects,  are  intended  to  ensure  that  learning  continues 
throughout  the  school  year.”  (OSPI,  2000) 

The  state  also  promoted  improved  classroom-based  assessments  through  the  development 
and  distribution  of  assessment  Tool  Kits  and  a  piece  of  software  (CD-ROM)  called  NCS 
Mentor®.  The  Tool  Kits  are  intended  to  provide  teachers  with  strategies  to  assess  student 
performance  that  are  aligned  with  the  standards.  The  Tool  Kits  include  checklists  of  skills, 
observation  strategies,  models  of  written  tasks,  rating  scales  for  student  work,  and  generic 
protocols  for  conducting  personal  interviews  and  other  forms  of  oral  communication 
(Commission  on  Student  Learning,  1999).  The  Tool  Kits  also  include  content  frameworks  to 
help  teachers  align  their  classroom  activities  and  instruction  to  the  EARLs.  NCS  Mentor®  offers 
teachers  interactive  help  in  aligning  their  own  tests  with  the  EALRs. 

Washington  is  implementing  its  education  reform  gradually  over  a  period  of  a  decade 
(unlike  many  states — including  Texas,  Kentucky,  and  North  Carolina — which  implemented 
standards-based  reforms  rapidly).  For  example,  the  EARLs  for  reading,  writing,  mathematics, 
and  listening  were  developed  first  in  1995.  The  EARLs  for  science,  social  studies,  health/fitness 
and  the  arts  followed  in  1996.  The  implementation  of  the  WASL  has  been  even  more  gradual. 
The  fourth  grade  WASL  in  reading,  writing,  mathematics  and  listening  was  offered  for  the  first 
time  on  a  voluntary  basis  in  1996-97,  and  it  became  mandatory  the  following  year.  For  seventh 
grade  students,  the  assessments  were  voluntary  in  1997-98,  and  will  be  mandatory  in  the  2000-01 
school  year.  The  complete  assessment  system  will  be  fully  implemented  by  2008  (see  Table  3). 

Following  the  first  voluntary  administration  of  the  WASL,  a  standard-setting  committee 
met  to  decide  what  level  of  performance  would  constitutes  accomplishment  of  the  standards  in 
the  areas  of  reading  and  mathematics  in  each  of  the  tested  grades.  They  designated  four  levels  of 
performance  for  students,  two  levels  representing  performance  that  met  or  exceeded  the  standard 
(designated  Level  3  and  Level  4,  respectively)  and  two  levels  representing  performance  below 
the  standard  (Levels  1  and  2).  Four  levels  are  used  to  make  the  assessment  more  sensitive  to 
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changes  in  student  performance  over  time  and  to  provide  an  indication  of  the  distance  between  a 
student’s  performance  and  the  standard.  However,  for  most  public  reporting  purposes  results  for 
schools  in  reading  and  mathematics  are  presented  only  in  terms  of  the  percent  of  students  who 
meet  or  exceed  the  standard.  The  results  for  the  listening  and  writing  assessments  indicate  only 
whether  the  student  meets  the  standard  or  does  not. 


Table  3 

Washington  Assessment  of  Student  Learning  (WASL)  Implementation  Timeline 


Subject  (s) 

School  and 
grade  level 

Available  for 
voluntary  use 

Required 

Reading,  writing. 

Elementary  (Grade  4) 

Spring  1997 

Spring  1998 

listening,  mathematics 

Middle  (Grade  7) 

Spring  1998 

Spring  2001 

High  (Grade  10) 

Spring  1999 

Spring  2001 

Science 

Elementary  (Grade  5) 

Spring  2002 

Spring  2005 

Middle  (Grade  8) 

Spring  2000 

Spring  2001 

High  (Grade  10) 

Spring  2000 

Spring  2001 

Social  studies 

Elementary  (Grade  5) 

Spring  2003 

Spring  2006 

Middle  (Grade  8) 

Spring  2003 

Spring  2006 

High  (Grade  10) 

Spring  2003 

Spring  2006 

Arts 

Elementary  (Grade  5) 

Spring  2004 

Spring  2008 

Middle  (Grade  8) 

Spring  2004 

Spring  2007 

High  (Grade  10) 

Spring  2004 

Spring  2007 

Health  and  fitness 

Elementary  (Grade  5) 

Spring  2004 

Spring  2008 

Middle  (Grade  8) 

Spring  2004 

Spring  2007 

High  (Grade  10) 

Spring  2004 

Spring  2007 

Accountability 

The  third  component  of  Washington’s  education  reform  system  is  school  and  district 
accountability.  The  stated  purpose  of  the  accountability  system  is  to  improve  student  learning 
and  the  achievement  of  the  standards  by  providing  a  structure  of  incentives  and  assistance  for 
schools  and  districts.  Like  many  other  states,  Washington’s  reforms  focus  on  schools  and 
districts — rather  than  teachers  or  students — as  the  units  of  performance  and  accountability.  The 
body  responsible  for  oversight  and  the  development  of  accountability  policies  is  now  the 
Academic  Achievement  and  Accountability  Commission  (referred  to  as  the  A+  Commission). 
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The  Commission  has  specific  responsibilities,  including  adopting  and  revising  performance 
improvement  goals;  setting  standards;  adopting  criteria  to  identify  successful  schools  and  those 
in  need  of  assistance;  identifying  performance  incentive  systems;  annually  reviewing  the 
assessment  system,  and  recommending,  by  September  2000,  accountability  policies,  including 
state  intervention  strategies  for  low-performing  schools. 

According  to  educators  in  Washington,  the  Commission  is  likely  to  recommend  an 
incremental  approach  on  the  part  of  the  state  towards  intervention  in  low-performing  schools. 
The  initial  responsibility  to  help  schools  will  probably  reside  with  districts,  but  if  the  district 
action  fails  to  improve  performance  in  a  school,  the  state  will  intervene.  However,  it  is  not  yet 
clear  what  the  extent  of  this  intervention  will  be. 

Professional  Development 

The  final  component  of  the  state’s  educational  reform  is  professional  development  for 
teachers.  Sixteen  “Regional  Learning  and  Assessment  Centers”  were  established  across  the  state 
to  provide  assistance  to  local  schools  and  districts.  The  Centers  offer  a  range  of  professional 
development  opportunities  on  a  fee  basis,  including  training  related  to  the  state  standards, 
curriculum  alignment,  and  the  new  statewide  assessments.  The  state  also  encouraged  districts 
and  schools  to  send  study  teams  to  receive  training  in  classroom-based  assessment  strategies 
developed  by  Richard  Stiggins  (1996).  In  the  second  year  of  the  reform,  the  state  distributed 
10,000  copies  of  Stiggins'  book  to  participating  schools  and  districts. 

The  Education  Reform  Act  also  allocated  additional  resources  in  the  form  of  Student 
Learning  Improvement  Grants  (SLIG)  that  districts  use  for  professional  development.  Districts 
that  applied  received  a  per  pupil  allocation  of  funds  for  professional  development  in  the  1997-98 
school  year.  In  1998-99,  the  program  was  modified  to  provide  “Learning  Improvement 
Allocations”  to  all  school  districts  to  "enhance  the  ability  of  instructional  staff  to  teach  and  assess 
the  EALRs  for  reading,  writing,  communication  and  math.. .(with)  special  emphasis...  given  to 
successful  teaching  of  reading"  (Bergeson,  Yoshitomi,  and  Butts,  1998).  In  1999-2000  the 
monetary  awards  were  made  contingent  upon  districts  adding  three  professional  development 
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days  to  the  school  calendar  to  focus  on  improving  student  learning  consistent  with  the  education 
reform. 

WASL  Results 

Initial  results  from  WASL  showed  that  only  a  minority  of  students  were  achieving  the 
rigorous  standards  embodied  in  the  state  reforms  (see  Table  4).  Fewer  than  one-quarter  of  the 
students  met  the  standards  in  mathematics  in  the  first  year  that  WASL  was  administered.  Fewer 
than  one-half  met  the  standards  in  reading  or  writing.  The  most  recent  WASL  results  were  more 
encouraging,  showing  gains  in  the  percentage  of  students  meeting  the  standards  in  mathematics, 
reading  and  listening  in  elementary  and  middle  schools.  Of  course,  there  is  still  much  room  for 
improvement.  Approximately  one-third  of  fourth  graders  and  more  than  one-half  of  seventh 
graders  tested  at  Level  1  this  year.  Writing  performance  has  been  mixed.  Fourth  grade  writing 
scores  have  dropped  for  the  second  consecutive  year,  but  there  was  improvement  among  seventh 
graders. 


Table  4 

Statewide  WASL  Results 

(percent  of  students  meeting  standard) 


Subject 

1997 

Fourth  grade 
1998 

1999 

Seventh  grade* 
1997  1998 

1999 

Mathematics 

21 

31 

37 

_ 

20 

24 

Reading 

48 

56 

59 

_ 

38 

41 

Writing 

43 

37 

33 

_ 

31 

37 

Listening 

62 

71 

71 

- 

80 

87 

*Grade  7  WASL  was  introduced  in  1998  on  a  voluntary  basis. 


Other  Elements  of  Education  Reform 

Other  components  have  been  added  to  the  reform  during  the  past  couple  of  years  , 
including  an  annual  second  grade  reading  assessment,  specific  reading  improvement  goals  for 
fourth  grade,  and  supplemental  reading  teachers  for  low  performing  schools  (Bergeson, 
Yoshitomi,  and  Butts,  1999),.  In  1998  the  state  adopted  a  second  grade  reading  assessment  to 
provide  an  early  identification  of  students  with  potential  reading  problems.  Districts  must  select 
a  test  from  those  approved  by  the  state,  and  teachers  administer  it  individually  to  all  second 
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grade  students.  The  purpose  of  the  test  is  to  identify  students  who  are  “substantially  below  grade 
level”  so  they  can  receive  supplemental  reading  instruction. 

The  legislature  also  passed  new  regulations  requiring  all  districts  to  establish  fourth  grade 
reading  goals  on  WASL  to  be  achieved  by  the  end  of  the  2000-01  school  year.  Each  district 
must  choose  either  1996-97  or  1997-98  as  a  baseline  against  which  to  measure  progress.  They 
must  establish  a  reading  improvement  goal  that  would  result  in  25  percent  fewer  fourth  grade 
students  failing  to  meet  the  standard  in  the  2000-01  school  year.  For  example,  if  60  percent  of 
students  failed  to  meet  the  standard  in  the  baseline  year,  the  goal  for  2001  would  be  a  drop  of  at 
least  25  percent  in  this  percentage  i.e.,  no  more  than  45  percent  failing  to  meet  the  reading 
standard.  Districts  must  establish  similar  goals  for  mathematics  in  fourth  grade  and  seventh 
grade  by  2001;  these  goals  must  be  met  by  the  end  of  the  2003-04  school  year. 

The  newest  element  of  the  reform  is  the  Washington  Reading  Corps.  This  program 
provides  grants  to  districts  to  implement  “proven  research-based  mentoring  and  tutoring 
programs”  in  reading  for  low  performing  students  (Bergeson,  Yoshitomi,  and  Butts,  1999,  p  43). 
Such  programs  can  take  place  before,  during  or  after  school,  on  weekends  or  during  vacation 
times. 
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METHODOLOGY 


In  the  spring  of  1999,  we  surveyed  a  representative  sample  of  about  150  principals  and 
about  400  teachers  from  across  the  state  of  Washington.  Surveys  were  sent  to  elementary  and 
middle  school  principals  as  well  as  the  teachers  in  the  WASL-tested  grades  (fourth  and  seventh 
grade)  at  the  same  schools.  This  report  summarizes  the  results  of  the  survey  component  of  the 
project.  Case  studies  of  exemplary  teachers  in  these  grades  and  subjects  were  also  conducted, 
and  companion  reports  will  describe  the  case  study  findings. 

Sampling 

Schools  in  Washington  were  stratified  based  on  the  type  of  community  in  which  the 
school  was  located,  and  a  stratified  random  sample  of  schools  (based  on  proportional 
representation  of  the  strata)  was  selected.  The  three  strata  were  urban,  urban  fringe/large  town, 
and  small  town/rural.  Schools  with  fewer  than  20  students  in  the  tested  grade  were  excluded 
from  the  sampling  frame,  as  were  schools  with  recent  changes  in  their  service  areas.  Middle 
schools  were  limited  to  schools  that  administered  WASL  on  a  voluntary  basis.  For  each  of  the 
survey  populations  (elementary  schools  and  middle  schools),  70  schools  were  selected.  No 
school  was  chosen  for  more  than  one  sample. 

A  letter  was  sent  to  the  principal  of  each  school  at  the  beginning  of  1999  explaining  the 
study  and  requesting  the  names  of  the  instructors  teaching  the  identified  grade  (and,  in  middle 
schools,  the  identified  subject).  Principals  were  subsequently  contacted  by  telephone  to  retrieve 
these  names.  Ninety-four  percent  of  the  principals  in  the  sampled  schools  provided  the  requested 
information.  In  small  schools,  all  teachers  in  the  target  grade  levels  (fourth  and  seventh  grades) 
were  included  in  the  study.  In  large  schools,  it  was  necessary  to  sample  teachers  in  order  to  use 
the  available  resources  to  collect  data  from  a  sizeable  number  of  schools.  In  elementary  schools 
with  more  than  three  teachers,  a  random  sample  of  three  teachers  was  selected.  In  middle 
schools  with  more  than  two  math  or  writing  teachers,  random  samples  of  up  to  two  writing 
teachers  and  up  to  two  math  teachers  were  selected. 
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Principals  and  teachers  were  then  contacted  by  mail.  The  contact  letter  explained  the 
study  and  asked  for  their  participation.  Enclosed  with  the  request  was  a  letter  from  the 
Superintendent  of  Public  Instruction  urging  respondents  to  cooperate,  a  copy  of  the  survey  to  be 
completed,  a  return  envelope,  and  a  ten  dollar  gift  certificate  for  purchasing  books  or  other 
instructional  materials.  Principals  and  teachers  could  keep  the  gift  certificate  regardless  of 
whether  they  returned  the  survey. 

A  total  of  108  principals  (77  percent)  and  277  teachers  (69  percent)  returned  completed 
surveys.  Table  5  contains  the  survey  completion  rates  for  each  of  the  four  samples.  The  median 
tenure  for  principals  who  responded  was  ten  years  at  their  current  school.  On  average,  the 
teachers  who  completed  surveys  had  about  a  dozen  years  of  experience;  the  median  tenure  for 
fourth  grade  teachers  was  17  years  and  for  seventh  grade  teachers  it  was  nine  years.  Both  groups 
of  teachers  had  acquired  one-half  of  their  teaching  experience  at  their  current  school.  About  one- 
half  of  the  teachers  had  master’s  degrees.  Teachers  in  the  sample  resembled  the  teachers  in  the 
state  as  a  whole  in  terms  of  experience  and  education  level,  based  on  recent  research  conducted 
by  the  legislature  (Joint  Legislative  Audit  and  Review  Committee,  1999;  pp.  34-35). 

Table  5 

Survey  Samples  and  Response  Rates 

Elementary  school  (grade  4)  Middle  school  (grade~7i 

Respondent  Sample  size  Response  rate  Sample  size  Response  rate 

Principals  70  75.7%  70  78.6% 

Teachers _ 179 _ 74.9% _ 221 _ 64.7% 

In  terms  of  subject  matter,  very  few  teachers  in  either  grade  taught  only  writing  or  only 
mathematics.  All  fourth  grade  writing  teachers  were  responsible  for  multiple  subjects:  reading, 
writing,  mathematics,  communication,  social  studies,  and  science.  Many  fourth  grade  writing 
teachers  also  taught  arts,  health,  and/or  other  subjects.  At  the  seventh  grade  level,  almost  all 
writing  teachers  also  taught  reading  and  communication;  only  nine  percent  of  teachers  who 
identified  themselves  as  writing  teachers  did  not  teach  reading.  In  addition,  70  percent  of 
seventh  grade  writing  teachers  also  taught  social  studies,  mathematics,  science,  and/or  arts. 
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Similarly,  the  mathematics  teachers  were  multi-disciplinary.  All  fourth  grade 
mathematics  teachers  also  taught  reading,  writing,  social  studies  and  science.  One-half  of  the 
seventh  grade  mathematics  teachers  also  taught  other  subjects.  Eight  percent  taught  reading  and 
mathematics  exclusively  while  41  percent  taught  reading,  social  studies,  science,  arts,  and/or 
health  in  addition  to  mathematics. 

Survey  Development 

The  teacher  surveys  were  similar  to  surveys  the  project  developed  in  Kentucky  the 
previous  school  year;  however,  they  were  modified  to  reflect  the  language  and  priorities  of  the 
Washington  reform.  The  teacher  surveys  collected  information  about  teachers’  familiarity  with 
and  opinions  about  the  state  reform,  their  participation  in  professional  development,  and  their 
classroom  practices.  In  terms  of  practice,  the  survey  asked  teachers  about  their  allocation  of  time 
to  different  subjects,  their  teaching  strategies,  and  the  topics  they  covered  within  writing  and 
mathematics.  Additionally,  teachers  reported  recent  changes  in  instruction  and  the  major  factors 
that  influenced  instructional  changes,  including  the  state  reform. 

Questions  about  the  content  of  the  writing  and  mathematics  curriculum  were  based  on  the 
EALRs.  The  EALRs  in  writing  specify  four  broad  areas  of  writing  proficiency.  Students  should 
write  clearly  and  effectively,  write  in  a  variety  of  forms  for  different  audiences  and  purposes, 
understand  and  use  the  steps  of  the  writing  process,  and  be  able  to  analyze  and  evaluate  the 
effectiveness  of  written  work  (Washington  State  Commission  on  Student  Writing,  1997).  These 
four  areas  are  subdivided  into  14  behaviors,  ranging  from  “develop  concept  and  design”  to  “seek 
and  offer  feedback.”  The  survey  asked  teachers  about  their  emphasis  on  these  14  writing 
behaviors,  the  teaching  strategies  they  use,  and  the  types  of  written  assignments  they  give. 

In  mathematics,  the  EALRs  specify  five  broad  areas  of  proficiency.  Students  should  be 
able  to  understand  and  apply  the  concepts  and  procedures  of  mathematics,  use  mathematics  to 
define  and  solve  problems,  use  mathematical  reasoning,  communicate  knowledge  and 
understanding  both  in  everyday  and  mathematical  language,  and  understand  how  mathematical 
ideas  connect  within  mathematics,  to  other  subject  areas  and  to  real-life  situations.  The  first  area 
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of  proficiency  emphasizes  mathematics  content  and  curriculum:  number  sense,  measurement, 
geometric  sense,  probability  and  statistics,  and  algebraic  sense.  The  rest  of  the  proficiencies 
focus  on  mathematical  processes,  such  as  “investigate  situations,”  “analyze  information,”  and 
“represent  and  share  information.”  The  surveys  asked  teachers  about  these  areas  of  emphasis 
and  about  specific  instructional  activities  that  occur  in  their  classrooms.  We  also  asked  teachers 
how  much  their  actions  had  changed  between  the  1997-98  and  1998-99  school  years. 

Principals  provided  information  about  education  reform  at  both  the  district  and  school 
levels.  At  the  district  level,  they  responded  to  questions  about  curriculum,  standards, 
assessments,  and  accountability.  At  the  school  level,  they  responded  to  questions  about 
implementation  (e.g.,  how  the  respondent  learned  about  the  reform,  whether  they  endorse  its 
principles,  etc.),  impact  (e.g.,  changes  made  as  a  result  of  the  reform,  factors  that  were  most 
influential,  etc.),  and  testing  (e.g.,  test  preparation  practices). 

Most  of  the  items  on  both  surveys  focused  on  specific  behaviors,  but  we  also  asked  for 
teachers’  and  principals’  opinions  about  a  number  of  issues,  including  the  Washington 
assessments  and  their  impact  on  schools,  classroom  practices,  and  student  learning.  The  surveys 
also  contained  questions  related  to  respondent  background  and  professional  development.  Most 
of  the  survey  questions  were  presented  in  a  closed  format.  Respondents  were  asked  to  provide 
numerical  answers  or  to  select  one  option  from  a  predetermined  set  of  options  (e.g.,  three-,  four-, 
and  five-point  Likert  scales,  and  yes/no  questions).  A  few  questions  were  open-ended, 
permitting  principals  and  teachers  to  write  in  their  own  responses.  For  most  questions  about 
practice,  respondents  were  asked  about  current  behaviors  (during  the  1998-99  school  year)  and 
about  changes  during  the  past  two-year  period  (1997-98  and  1998-99  school  years).  Only 
respondents  who  had  at  least  two  years  of  experience  in  their  present  position  answered 
questions  about  changes  in  practice. 

WASL  Scores 

In  order  to  investigate  relationships  between  school  and  classroom  practices  and  student 
achievement,  we  obtained  school-level  WASL  scores  and  student  demographic  information  for 
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1998-1999  from  the  Office  of  the  Superintendent  of  Public  Instruction.  The  data  file  included 
the  number  of  students  tested  in  each  subject,  raw  WASL  scores,  and  the  number  achieving  the 
standard  in  each  subject.  The  file  also  included  student  demographic  information  at  the  school 
level,  including  race/ethnicity  and  eligibility  for  free  or  reduced-price  lunches. 

Data  Analysis 

For  most  questions  on  the  principal  survey,  we  computed  frequency  distributions  of 
responses  at  each  point  on  the  response  scale.  For  questions  requiring  a  numeric  response, 
means  and  standard  deviations  were  calculated.1  Analysis  of  the  open-response  questions 
required  coding  and  tabulation  of  the  individual  principal  and  teacher  responses. 

Because  we  sampled  teachers  in  the  larger  schools  (rather  than  surveying  all  teachers), 
we  had  to  weight  teachers  responses  to  obtain  results  that  reflected  all  teachers  in  Washington 
(fourth  grade  teachers,  seventh  grade  writing  teachers,  and  seventh  grade  mathematics  teachers). 
The  weights  insured  that  teachers  in  large  and  small  schools  were  given  the  proper  influence  in 
the  descriptive  statistics.  The  weight  assigned  to  each  teacher  was  the  product  of  the  inverses  of 
the  probability  that  the  school  would  be  selected,  the  probability  the  teacher  would  be  selected, 
and  probability  that  the  sampled  individuals  would  participate  (complete  the  survey). 

The  purpose  of  the  surveys  was  to  obtain  early  indications  of  teacher  and  principal 
opinion  about  the  Washington  education  reform,  and  to  judge  its  initial  impact  on  practice.  For 
this  reason,  the  surveys  were  broad  in  nature  and  many  questions  were  asked.  The  data 
collection  was  designed  to  provide  a  large  amount  of  information  from  a  number  of  groups  rather 
than  to  maximize  our  power  for  making  specific  comparisons  between  groups.  Thus,  we  do  not 
focus  much  attention  on  testing  the  significance  of  differences  between  specific  groups  of 
principals  or  teachers.  As  a  general  rule  of  thumb,  a  difference  between  two  percentage 
estimates  of  15-20  points  would  be  large  enough  for  statistical  significance  at  the  0.05  level 
(without  a  correction  for  multiple  comparisons).  However,  given  the  design  of  the  study  and  the 

1  The  standard  error  is  a  statistic  that  can  be  used  as  a  guideline  to  judge  the  accuracy  of  the  reported 
percentages.  In  this  study  accurate  estimates  of  the  standard  error  are  difficult  to  obtain  because  teachers  were 
sampled  within  schools,  and  the  responses  of  teachers  within  the  same  school  cannot  be  assumed  to  be  independent. 
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large  numbers  of  comparisons  being  made,  most  standard  statistical  tests  properly  applied  would 
fail  to  detect  many  real  differences.  Instead  we  focus  on  differences  which  seem  large  enough  to 
be  of  practical  importance.  The  downside  of  this  approach  is  that  it  is  almost  certain  that  there 
will  be  a  small  number  of  comparisons  that  we  highlight  that  are  in  fact  due  to  chance.  However, 
given  the  nature  of  the  study  this  weakness  was  preferred  to  the  option  of  missing  many 
important  comparisons  due  to  a  stringent  significance  threshold.  We  did  use  the  significance 
levels  as  a  guideline  for  interpreting  results. 

As  is  the  case  with  all  survey  research,  several  factors  may  threaten  the  validity  of  the 
conclusions  reached  in  this  study.  There  may  be  selection  effects  because  not  all  principals 
provided  us  with  teachers’  names,  and  not  all  principals  or  teachers  chose  to  participate. 

Although  the  response  rates  were  reasonably  high,  these  refusals  may  have  introduced  some 
degree  of  bias  into  the  reported  results.  One  must  also  be  cautious  about  self-reported  data. 
Respondents  may  have  answered  in  ways  they  considered  socially  desirable,  leading  to  results 
that  do  not  reflect  teachers’  true  beliefs. 

To  avoid  overly  complex  language  we  will  often  omit  explicit  reference  to  the  self- 
reported  nature  of  the  results.  ‘One-half  of  the  teachers  have  Masters’  degrees’  is  far  easier  to 
read  than  ‘one-half  of  the  fourth-grade  teachers  in  our  sample  reported  that  they  have  Masters’ 
degrees.’  The  reader  should  remember  that  all  these  results  are  based  on  principal  and  teacher 
survey  responses.  In  addition,  we  occasionally  refer  to  the  results  for  'seventh-grade  teachers' 
instead  of  ‘seventh-grade  teachers  who  teach  writing  or  mathematics.’  The  reader  should  keep  in 
mind  that  we  surveyed  only  writing  and  mathematics  teachers  at  the  seventh  grade. 

To  simply  the  presentation  of  results  from  scales  with  four  or  more  response  options,  we 
often  will  combine  the  top  two  levels  into  a  single  category.  For  example,  the  survey  asked 
teachers’  opinions  about  the  degree  to  which  reform  elements  promoted  better  instruction  and 
increased  student  learning  using  a  four  point  scale:  none,  a  small  amount,  a  moderate  amount, 
and  a  great  deal.  If  this  does  not  distort  the  pattern  of  responses,  we  will  combine  the  top  two 
categories,  “moderate  amount”  and  “great  deal”  and  report  the  percentage  of  teachers  who 
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indicated  “a  moderate  amount  or  a  great  deal.”  In  the  few  cases  where  there  were  differences 
between  the  distribution  of  responses  in  the  top  two  categories,  we  will  present  the  disaggregated 
responses. 

Finally,  we  used  multiple  regression  analysis  to  investigate  the  relationship  between 
WASL  scores  and  school  practices  as  reported  on  the  principal  and  teacher  surveys.  The 
question  we  examined  was  whether  school  practices  were  significantly  related  to  student 
achievement,  controlling  for  differences  in  school  size  and  student  demographics.  The  analysis 
proceeded  in  three  steps.  First,  using  data  on  all  schools  in  the  state,  we  modeled  WASL  scores 
as  a  function  of  schools  size  and  student  demographics.  The  variables  included  in  this  analysis 
are  shown  in  Table  D.l  and  the  results  are  shown  in  Table  D.2  in  Appendix  D.  All  variables  that 
were  significantly  related  to  WASL  scores  in  the  statewide  analysis  were  included  in  subsequent 
analyses  of  our  survey  sample.  Second,  we  restricted  the  analysis  to  our  survey  sample  of 
elementary  and  middle  schools.  Using  regression,  we  examined  the  relationships  between 
background  factors  and  WASL  scores  separately  in  these  two  groups  of  schools.  The  overall  the 
results  were  consistent  enough  to  warrant  pooling  our  samples  of  elementary  and  middle  schools. 
For  example,  in  mathematics  the  effects  of  our  predictors  were  almost  identical  at  the  fourth  and 
seventh  grades.  The  pooled  sample  included  106  schools  with  both  principal  and  teacher  survey 
responses. 

The  third  step  was  to  investigate  the  relationship  between  WASL  scores  and  school  and 
classroom  practices  from  the  surveys,  controlling  for  the  background  factors  that  were  significant 
in  the  statewide  analysis.  We  included  a  subset  of  survey  responses  that  reflected  important 
aspect  of  the  reform.  From  the  principal  survey,  we  included  the  amount  of  SLIG  money 
received,  the  existence  of  district  standards  in  the  four  subjects  tested  by  WASL,  the  perceived 
degree  of  curriculum  alignment  in  these  subjects,  and  the  number  of  specific  activities  the  school 
had  initiated  in  response  to  WASL.  From  the  teacher  survey  we  included  measures  of  teaching 
experience,  professional  development,  the  degree  to  which  professional  development  focused  on 
Washington’s  education  reform,  curriculum  alignment,  teachers’  understanding  of  the  EALRs 
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and  the  WASL,  and  WASL-specific  preparation  activities  in  writing  and  mathematics.  A  list  of 
the  specific  items  and  response  options  included  in  the  analysis  will  be  found  in  Appendix  C. 

Generalizability  of  Findings 

The  sample  was  drawn  to  maximize  the  chances  of  obtaining  representative  groups  of 
Washington  elementary  school  principals,  middle  school  principals,  fourth  grade  teachers, 
seventh  grade  writing  teachers  and  seventh  grade  mathematics  teachers.  To  test  the  validity  of 
the  sampling  process,  we  compared  key  features  of  schools  with  completed  principal  surveys 
with  schools  in  the  state  as  a  whole  on  four  variables:  school  enrollment  in  the  tested  grade, 
percent  minority  in  the  school,  WASL  mathematics  scores  and  WASL  writing  scores.  The 
school-level  means  were  similar  to  the  population  means  for  elementary  schools  and  middle 
schools  on  these  variables  (see  Table  6). 

Table  6 

Comparison  of  State  and  Sample 

(mean  values) 


Elementary  school  (grade  41  Middle  school  (grade  7) 

Feature _ State _ Sample _ State _ Sample 


Percent  minority 

24.7 

24.3 

21.4 

21.8 

Grade  enrollment 

70.9 

76.7 

171.3 

161.4 

WASL  math* 

30.6 

30.6 

18.9 

16.8 

WASL  writing* 

35.8 

34.2 

30.1 

28.7 

Note:  *  Percent  meeting  standard 
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RESULTS:  ELEMENTARY  AND  MIDDLE  SCHOOL  PRINCIPALS 

Almost  all  principals  reported  that  they  had  a  good  understanding  of  the  Washington 
education  reform,  and  they  endorsed  its  central  goals  for  students.  Much  of  the  professional 
development  they  participated  in  addressed  the  EALRs,  WASL  and  classroom-based 
assessments.  Only  a  small  percentage  of  the  principals  were  directly  involved  in  state 
committees  helping  to  develop  or  implement  the  reform,  but  most  principals  participated  on 
district  or  school  committees,  particularly  committees  working  to  align  curriculum  with  the 
EALRs. 

According  to  principals,  most  districts  added  or  modified  their  standards  and  assessments 
to  bring  them  in  line  with  the  EALRs.  Most  principals  thought  the  alignment  between  local 
policies  and  the  EALRs  was  good,  particularly  in  the  WASL-tested  subjects.  One  consequence 
of  the  reform  is  that  the  amount  of  testing  is  rising  in  both  elementary  and  middle  schools.  In 
addition  to  the  state-mandated  tests,  district  are  increasing  local  testing,  using  both  commercial 
tests  and  locally  developed  tests. 

The  vast  majority  of  principals  reported  that  the  Washington  education  reform  promoted 
better  instruction  and  increased  student  learning,  and  they  indicated  that  the  EALRs  and  WASL 
were  the  most  influential  elements  of  the  reform.  Principals  felt  widespread  pressure  for  students 
to  do  well  on  all  outcome  indicators,  but  they  felt  the  greatest  pressure  for  students  to  perform 
well  on  the  state  assessments  (WASL  and  the  state  norm-referenced  test).  The  greatest  perceived 
pressure  to  perform  well  came  from  district  administrators,  the  media  and  OSPI. 

According  to  principals,  education  reform  led  to  valuable  professional  development 
opportunities  for  teachers,  and  school-initiated  professional  development  focused  more  on 
curriculum  alignment,  the  EALRs,  and  WASL  than  on  classroom-based  assessment  or  district 
tests.  Schools  took  a  number  of  actions  specifically  designed  to  improve  WASL  scores, 
including  providing  professional  development,  sharing  information  about  WASL,  trying  to 
motivate  teachers  and  students,  changing  school  schedules,  and  improving  curriculum  and 
instruction.  Most  principals  indicated  that  test  preparation  activities  accounted  for  most  past 
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WASL  score  gains,  although  they  also  believed  that  better  classroom-based  assessment  would 
lead  to  gains  in  the  future. 

Principals’  Understanding  of  Educational  Reform 

Almost  all  principals  reported  that  they  understood  the  central  elements  of  the 
educational  reform  well  or  very  well.  Table  7  shows  that  over  80  percent  of  principals  were 
comfortable  with  their  knowledge  of  the  EALRs,  WASL  and  the  alignment  of  curriculum  and 
instruction.  Almost  as  many  were  confident  in  their  knowledge  of  classroom-based  assessment. 


Table  7 

Principals’  Understanding  of  Education  Reform 

(percent  of  principals  who  understand  well  or  very  well) 


Aspect  of  reform 

Elementary 

school 

Middle 

school 

Washington  student  assessment  (WASL) 

90 

92 

Essential  learnings  and  benchmarks 
(EALRs) 

86 

96 

Aligning  curriculum  and  instruction  with 
EALRs 

80 

88 

Classroom-based  assessments  (e.g.,  Stiggins 
training,  assessment  Tool  Kits) 

80 

76 

Not  only  did  principals  understand  the  reform,  but  they  endorsed  its  key  goals  for 
students.  As  Table  8  shows,  about  three-quarters  of  principals  believed  the  goals  of  the  reform 
were  attainable,  and  an  even  greater  percentage  believed  the  standards  set  by  the  EALRs  were 
appropriate. 


Table  8 

Principals’  Opinions  About  Reform  Goals 

(percent  of  principals  who  somewhat  agree  or  strongly  agree) 


Statement 

Elementary 

school 

Middle 

school 

The  EARLs  are  appropriate  for  the  benchmark 
grade  levels  (grades  4, 7  and  10) 

87 

88 

The  goals  of  Washington’s  education  reform  are 
attainable  (e.g.,  all  students  will  be  able  to 
think  analytically,  logically  and  creatively) 

79 

72 

Principals  reported  participating  in  a  large  amount  of  professional  development  during 
the  1997-98  and  1998-99  school  years,  much  of  it  focusing  on  the  reform.  The  median 
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elementary  principal  spent  80  hours  in  professional  development  during  the  past  two  years,  with 
65  hours  of  that  time  related  to  Washington’s  education  reform.  Similarly,  the  median  middle 
school  principal  spent  80  hours  in  professional  development  during  the  past  two  years,  and  50  of 
those  hours  were  related  to  reform.  In  terms  of  emphasis,  more  than  80  percent  of  principals 
reported  that  their  professional  development  placed  either  a  moderate  amount  or  a  great  deal  of 
emphasis  on  the  EALRs,  WASL,  and  curriculum  alignment.  Slightly  fewer  (72  percent)  said 
their  professional  development  emphasized  classroom-based  assessment. 

Few  of  the  principals  we  surveyed  served  on  any  state  committees  responsible  for 
planning  or  implementing  the  reform,  but  many  served  on  reform-related  district  committees  and 
one-half  or  more  served  on  committees  at  their  school.  Table  9  shows  that  most  principals  were 
directly  involved  in  aligning  curriculum  and  instruction  with  EALRs  at  the  district  and  school 
levels.  A  slightly  higher  percentage  of  middle  school  principals  than  elementary  school 
principals  participated  in  district-level  planning  committees  of  each  type. 

Table  9 

Principal  Service  on  Committees  Related  to  Education  Reform 

(percent  of  principals) 


Committee 

Elementarv  school 
District  School 

Middle  school 
District  School 

Alignment  of  curriculum  and  instruction 

43 

63 

50 

76 

with  EALRs 

Developing  EALRs  or  related  materials 

33 

51 

40 

60 

Preparing  classroom  based  assessment 

18 

57 

26 

56 

materials 

Developing  WASL  or  related  materials 

12 

53 

32 

60 

Developing  accountability  system 

14 

53 

32 

50 

Alignment  of  Standards,  Assessments  and  Curriculum 

Many  districts  had  content  standards  in  the  core  subject  areas  prior  to  the  adoption  of  the 
EALRs,  and  almost  all  districts  took  actions  to  adopt  or  revise  standards  after  the  EALRs  were 
developed.2  More  than  two-thirds  of  the  elementary  school  principals  indicated  that  their 


2  The  surveys  were  sent  to  a  representative  sample  of  elementary  and  middle  school  principals,  and  the 
numbers  in  the  table  generalize  to  all  principals  in  the  state  (within  the  margin  of  sampling  error).  They  do  not 
necessarily  generalize  to  all  districts  in  the  state. 
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districts  had  standards  in  reading,  writing  and  mathematics  prior  to  the  adoption  of  the  EALRs 
(see  Table  10).  The  percentages  were  lower  for  the  other  subjects,  but  in  every  subject  at  least 
one-third  of  the  elementary  principals  confirmed  the  existence  of  district  standards  prior  to  the 
EALRs.  The  percentages  were  lower  for  middle  school  principals,  but  the  pattern  was  similar. 

After  the  EALRs  were  adopted,  almost  all  districts  took  actions  to  bring  local  standards 
in  line  with  state  standards,  either  by  developing  new  standards  or  revising  existing  ones.  As 
Table  10  shows,  87  percent  or  more  of  principals  indicated  that  their  district  took  actions  to 
revise  or  develop  standards  in  the  four  subjects  currently  tested  by  WASL.  Fewer,  but  still 
many,  principals  reported  having  district  standards  in  subjects  not  tested  by  WASL. 

Table  10 

Existence  of  District  Standards 

(percent  of  principals) 


Had  district  standards  Revised  or  developed  standards 

prior  to  EALRs  since  EALRs 

Subjects _ Elementary _ Middle _ Elementary _ Middle 


Reading 

76 

47 

87 

94 

Writing 

66 

53 

89 

96 

Mathematics 

79 

44 

90 

90 

Communication 

36 

29 

88 

87 

Social  studies 

53 

40 

84 

82 

Science 

61 

40 

79 

87 

Arts 

43 

24 

77 

66 

Health  and  fitness 

45 

28 

63 

71 

As  a  result  of  these  actions,  most  principals  believed  that  their  district’s  standards  were 
aligned  with  the  EALRs,  particularly  in  the  WASL-tested  subjects.  As  Figure  1  shows,  in 
reading,  writing  and  mathematics  more  than  90  percent  of  principals  reported  their  district’s 
standards  to  be  somewhat  well  aligned  or  very  well  aligned  with  the  EALRs.  Over  80  percent  of 
principals  thought  their  district’s  assessments  were  aligned  with  WASL  in  these  three  subjects, 
as  well.  The  values  were  slightly  lower  for  communication/listening.  In  subjects  not  tested  by 
WASL,  between  one-half  and  three-quarters  of  principals  felt  their  district’s  standards  were 
aligned  with  the  EALRs.  Across  the  subjects,  elementary  school  principals  reported  their  district 
standards  to  be  more  aligned  with  state  standards  than  middle  school  principals,  i.e.,  elementary 
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school  principals  were  more  likely  to  report  that  local  standards  were  “very  well  aligned,”  and 
middle  school  principals  were  more  likely  to  report  that  local  standards  were  “somewhat  well 
aligned”  with  EALRs. 

Figure  1 

Alignment  of  State  and  District  Standards 

(percent  of  elementary  school  (ES)  and  middle  school  (MS)  principals 
indicating  district  standards  are  somewhat  well  or  very  well  aligned  with  EALRs) 

Reading-ES 
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Almost  all  principals  also  reported  that  their  schools’  curriculum  was  well  aligned  with 
the  EALRs  in  the  WASL-tested  subjects.  Figure  2  shows  that  nearly  one-half  or  more  of 
principals  reported  strong  alignment  between  curriculum  and  the  EALRs  in  the  tested  subjects. 
The  percentage  drops  to  one-quarter  or  less  in  the  non-tested  subjects.  The  same  pattern  holds 
for  curriculum  in  the  non-tested  grades. 

As  in  the  case  of  standards,  school  districts  also  appear  to  have  changed  their  assessments 
in  response  to  Washington’s  education  reform.  Many  have  added  or  revised  assessments:  70 
percent  of  principals  reported  that  their  districts  have  implemented  new  district  assessments  since 
the  Washington  education  reform,  and  68  percent  changed  the  content  of  their  assessments  to 
align  them  with  EALRs.  Seventy-five  percent  or  more  of  the  principals  believe  that  their 


■  Very  well  aligned 
□  Somewhat  well  aligned 
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district's  tests  are  aligned  with  WASL  in  the  four  WASL-tested  subjects. 


Figure  2 

Alignment  of  School  Curriculum  with  Standards 

(percent  of  principals  reporting  curriculum  very  well  aligned  with  EALRs) 
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Eighty-one  percent  of  principals  reported  that  their  district  also  tested  in  at  least  one  state- 
tested  subject.3  Most  of  the  additional  district  testing  was  in  the  subjects  of  reading,  writing  and 
mathematics  (in  that  order).  One-quarter  of  principals  also  reported  that  their  district  required 
student  testing  in  at  least  one  subject  not  currently  tested  by  the  state  (e.g.,  social  studies, 
science,  arts,  or  health  fitness). 

Overall,  the  testing  burden  on  schools  appears  to  be  increasing.  The  number  of  WASL 
tests  being  administered  is  scheduled  to  increase,  and  districts  are  continuing  or  expanding  their 
own  testing  programs.  About  two-thirds  of  principals  (64  percent)  said  that  their  district 
increased  existing  testing  or  began  implementing  new  district  assessments  since  the  state  reform. 
Only  16  percent  of  principals  reported  that  their  districts  phased  out  assessments  or  planned  to 

3  During  the  1998-99  school  year,  WASL  tests  in  reading,  writing,  mathematics,  and  communication  were 
administered  in  grades  four  and  seven,  and  ITBS  tests  in  reading  and  mathematics  were  administered  in  grades  three 
and  eight.  Beginning  in  1999-2000,  the  ITBS  will  be  given  in  grades  three,  six,  and  nine. 
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phase  out  assessments  in  the  future. 

There  were  some  differences  in  the  frequency  of  district  testing  in  elementary  and  middle 
schools.  Overall,  a  slightly  higher  percentage  of  elementary  school  principals  (85  percent)  than 
middle  school  principals  (76  percent)  reported  supplemental  district  testing  in  at  least  one 
subject.  The  difference  was  large  only  in  the  subject  of  reading,  where  87  percent  of  elementary 
principals  reported  additional  district  testing  compared  to  57  percent  of  middle  school  principals. 
Most  districts  that  administered  their  own  tests  did  so  in  more  than  one  grade  level,  but  fewer 
than  one-quarter  of  principals  reported  that  their  district  tested  students  in  the  first  grade. 

Districts  administered  a  variety  of  different  types  of  assessments,  including 
commercially-developed  and  locally-developed  tests  in  both  multiple-choice  and  performance 
formats.  Commercial,  standardized  tests  (e.g.,  Levels,  Stanford-9)  were  the  most  common;  two- 
thirds  of  the  principals  whose  districts  administered  tests  (67  percent)  used  this  type  of 
examination.  However,  more  than  one-half  of  the  principals  whose  districts  administered  tests 
gave  locally-developed  tests,  and  the  majority  of  these  were  performance  assessments.4 
Influence  of  Reform  Elements 

The  vast  majority  of  principals  reported  that  the  Washington  education  reform  promoted 
better  instruction  and  increased  student  learning.  As  Figure  3  shows,  some  elements  of  the 
reform  were  more  influential  than  others.  A  greater  percentage  of  the  principals  reported  that  the 
EALRs  and  the  WASL  exerted  a  positive  influence  on  instruction  than  reported  a  positive 
influence  from  classroom-based  assessments  or  district  assessments.  WASL  short  answer 
questions  and  WASL  extended  response  items  had  a  greater  impact  than  did  WASL  multiple 
choice  items.  In  addition  to  the  difference  shown  in  Figure  3,  elementary  school  principals  were 
more  likely  than  middle  school  principals  to  respond  that  these  education  reforms  had  “a  great 
deal”  of  influence  on  instruction  and  student  learning. 


4  Of  those  who  reported  district  or  school  developed  assessments,  48%  reported  district-designed 
performance  tasks,  26%  reported  district-designed  multiple  choice  tests,  31%  reported  school-designed  performance 
tests,  and  1 1%  reported  school  designed  multiple  choice  tests.  Some  reported  more  than  one  type  of  locally 
developed  test. 
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Figure  3 

Degree  to  Which  Reform  Elements  Promoted 
Better  Instruction  and  Increased  Student  Learning 

(percent  of  principals  reporting  a  moderate  amount  or  a  great  deal) 
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Almost  all  principals  agreed  that  teachers  need  to  change  their  teaching  practices  to 
support  the  education  reform  (see  Table  11).  They  also  believed  the  reform  was  encouraging 
changes  that  were  already  in  progress. 


Table  11 

Principals’  Opinions  About  Education  Reform 

(percent  of  principals  who  somewhat  agree  or  strongly  agree) 


Statement 

Elementary 

school 

Middle 

school 

Washington’s  education  reform  encourages  our 
school  to  make  the  changes  we  were  already  in 
the  process  of  making 

90 

76 

Teachers  need  to  change  their  teaching  practices 
to  support  Washington’s  education  reform 

98 

94 

Principals  felt  widespread  pressure  for  students  to  perform  well  on  all  outcome 
indicators,  but  they  felt  the  greatest  pressure  for  students  to  perform  well  on  the  state  assessments 
(WASL  and  the  ITBS).  (see  Figure  4).  WASL  scores  were  the  greatest  source  of  concern; 
overall  95  percent  of  principals  felt  a  moderate  amount  or  a  great  deal  of  pressure  for  their 
students  to  perform  well  on  WASL.  Since  WASL  was  mandatory  in  fourth  grade  in  1997-98  but 
not  in  seventh  grade  it  is  understandable  that  a  higher  percentage  of  elementary  principals  than 
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middle  school  principals  felt  “a  great  deal”  of  pressure  for  their  students  to  perform  well  on 
WASL.  However,  elementary  principals  also  reported  greater  pressure  for  students  to  do  well  on 
the  state  norm-referenced  test  (ITBS).  The  perceived  pressure  to  perform  well  on  district  tests 
and  classroom-based  assessments  is  less  intense  than  the  pressure  to  perform  well  on  the  state 
assessments,  in  part  because  some  districts  do  not  administer  district  tests. 

Figure  4 

Perceived  Pressure  for  Student  to  Perform  Well  on  Selected  Indicators 

(percent  of  elementary  school  (ES)  and  middle  school  (MS)  principals 
reporting  a  moderate  amount  or  a  great  deal) 
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The  pressure  to  perform  well  came  from  many  quarters,  but  district  administrators,  the 
media  and  OSPI  were  the  most  prominent  sources  reported  by  principals.  Figure  5  shows  that 
almost  all  principals  felt  a  moderate  or  a  great  deal  of  pressure  from  their  district  administrators, 
and  over  80  percent  felt  strong  pressure  from  the  media  and  from  OSPI.  About  two-thirds  of 
principals  also  felt  pressured  by  local  stakeholders:  parents  and  students,  school  staff  and  the 
business  community.  More  elementary  principals  felt  a  great  deal  of  pressure  than  middle  school 
principals,  particularly  from  the  business  community  and  the  media. 
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Figure  5 

Sources  of  Pressure  to  Improve  WASL  Performance 

(percent  of  principals  reporting  a  moderate  amount  or  a  great  deal  of  pressure) 
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Actions  in  Response  to  Reform 

Schools  initiated  a  number  of  actions  in  response  to  the  Washington  education  reform, 
including  refocusing  their  professional  development  activities  and  taking  a  number  of  specific 
steps  to  improve  student  performance  on  WASL.  Almost  all  principals  reported  that  education 
reform  led  to  valuable  professional  development  opportunities  for  teachers  (94  percent  of 
elementary  principals,  90  percent  of  middle  school  principals).  One  specific  instance  of  this  is 
the  Learning  Improvement  Allocations  (LIA)  schools  received  in  1998-99  to  support  reform- 
related  professional  development.5  The  typical  elementary  school  received  about  $12,500  and 
the  typical  middle  school  received  about  $14,000  in  LIA  funds.  In  addition,  about  70  percent  of 
elementary  schools  and  45  percent  of  middle  schools  used  funds  from  other  sources  (e.g..  Title  I, 
Goals  2000)  for  professional  development,  leading  to  an  increase  in  their  professional 
development  funding  of  about  50  percent,  on  average. 


5  Learning  Improvement  Allocations,  formerly  known  as  Student  Learning  Improvement  Grants  (SLIGs), 
totaled  $50.4  million  in  1999.  The  1999  State  legislature  replaced  LIAs  with  funds  for  Learning  Improvement  Days, 
up  to  three  staff  development  days  for  each  school. 
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Most  school-initiated  professional  development  focused  on  curriculum  alignment,  the 
EALRs,  and  WASL.  Three-quarters  or  more  of  the  principals  indicated  that  their  professional 
development  activities  focused  on  these  three  components  of  the  reform  (see  Table  12).  Only 
one-half  indicated  that  professional  development  focused  on  district  testing.  It  is  interesting  to 
note  that,  with  only  small  exceptions,  the  emphasis  of  professional  development  was  similar  for 
middle  schools  as  for  elementary  schools  and  for  teachers  in  benchmark  grades  as  for  teachers  in 
other  grades.  A  lower  percentage  of  schools  focused  professional  development  on  alignment  in 
mathematics  than  in  reading  and  writing.  Perhaps  mathematics  had  been  the  focus  the  previous 
year,  because  fewer  students  met  the  standards  in  mathematics  than  in  any  other  subjects  tested 
by  WASL.  A  substantially  lower  percentage  of  middle  schools  than  elementary  schools 
emphasized  classroom-based  assessments  or  district  assessments  than  professional  development. 

Table  12 

Focus  of  School  Professional  Development 

(percent  of  principals  reporting  a  moderate  amount  or  a  great  deal) 


Focus 

Elementarv  school 
Bench¬ 
mark  Other 

grades  grades 

Middle 

Bench¬ 

mark 

grades 

school 

Other 

grades 

Essential  learnings  and  benchmarks 
(EALRs) 

78 

75 

77 

61 

Washington  student  assessment  (WASL) 

78 

67 

71 

53 

Classroom-based  assessments  (e.g., 

Stiggins  training,  assessment  Tool  Kits) 

73 

71 

52 

50 

Aligning  curriculum  and  instruction  with 
EALRs  in  mathematics 

67 

60 

65 

62 

Aligning  curriculum  and  instruction  with 
EALRs  in  writing 

90 

81 

80 

67 

Aligning  curriculum  and  instruction  with 
EALRs  in  reading 

94 

92 

75 

74 

District  assessments 

52 

52 

36 

33 

Schools  have  taken  a  number  of  other  actions  to  improve  WASL  scores,  including 
providing  professional  development,  sharing  information  about  WASL,  trying  to  motivate 
teachers  and  students,  changing  school  schedules  and  other  related  policies,  and  improving 
curriculum  and  instruction.  Table  13  shows  the  range  of  activities  undertaking  by  schools  in 
response  to  WASL.  Many  of  these  actions  were  designed  to  help  students  master  the  knowledge 
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and  skills  embodied  in  the  EALRs.  Others  were  more  narrowly  focused  on  WASL-tested  skills 
and  may  lead  to  improved  WASL  scores  without  accompanying  improvements  in  students' 
underlying  knowledge  and  skills.  As  a  result,  information  about  the  actions  schools  have  taken 
to  improve  scores  is  important  in  assessing  the  validity  of  WASL  scores  (i.e.,  the  extent  to  they 
represent  real  improvement  in  student  master  of  standards). 

Table  13 

Activities  Undertaken  in  Response  to  WASL 

(percent  of  principals) 


Activity 

Elementary 

school 

Middle 

school 

Convey  Information  About  WASL 

Held  staff  meetings  that  focus  on  WASL  issues 

100 

98 

Held  cross-grade  meetings  to  discuss  WASL  test  results 

88 

78 

Had  teachers  or  school  leadership  team  take  WASL  test 

82 

70 

items 

Promote  Professional  Development 

Encouraged  teachers  to  obtain  assessment  Tool  Kit 

96 

88 

training 

Directed  Student  Learning  Improvement  Grant 

88 

96 

(SLIG/LIA)  funds  towards  WASL-related  activities 
Motivate  Students  and  Provide  Test  Preparation 
Implemented  test  preparation  activities  (e.g..  Example 

100 

92 

Tests) 

Appealed  to  teachers’  and  students’  school  pride  to  do 

88 

96 

well  on  WASL 

Provided  release  time  for  teachers  to  prepare  for  WASL 

67 

82 

Provided  incentives  for  students  related  to  WASL 

29 

35 

performance  (e.g.,  parties,  fieldtrips) 

Change  School  Schedules  and  Other  Policies 

Implemented  schedule  changes  that  increased  time  for 

71 

55 

math,  reading,  and/or  writing 

Extended  instructional  hours  (e.g.,  created  all-day 

49 

42 

kindergarten,  instituted  Summer  school,  created 
Saturday  school) 

Changed  report  card  format 

47 

4 

Instituted  a  student  grade-level  retention  or  promotion 

27 

46 

policy 

Transferred  teachers  to  different  grades  or  subjects 

16 

18 

Change  Curriculum  and  Instruction 

Developed  a  school  plan  for  improving  performance  on 

100 

72 

WASL 

Instituted  school  wide  policies  to  address  curriculum 

73 

65 

gaps  (e.g.,  use  of  Weekly  Reader,  "task  of  the  week") 
Created  homework  clubs 

39 

48 

33 


The  most  widespread  school  responses  to  WASL  were  to  convey  information  about  the 
tests  and  to  promote  professional  development  (see  Table  13).  Over  80  percent  of  schools 
organized  meetings  of  groups  of  teachers  and  staff  to  share  information  about  WASL  in  one 
form  or  another.  Almost  all  schools  also  offered  professional  development  opportunities  that 
focus  on  WASL-related  issues.  Almost  all  schools  also  engaged  in  test  preparation  activities  to 
motivate  students  and  prepare  them  for  taking  standardized  tests.  Over  one-quarter  provided 
explicit  incentives  for  students  to  do  well,  including  such  things  as  parties  and  fieldtrips.  About 
one-half  of  the  schools  changed  schedules  in  one  way  or  another  to  increase  or  focus  time  on 
tested  subjects.  Many  schools  also  instituted  school-wide  policies  to  address  curriculum  gaps. 

District  assessments  had  a  much  lower  profile  than  WASL  tests  for  most  schools.  As 
Table  14  shows,  between  50  percent  and  70  percent  of  principals  said  that  district  test  results 
were  publicly  reported  (compared  with  almost  universal  public  reporting  of  WASL  and  ITBS 
scores).  District  tests  were  used  more  for  instructional  purposes,  such  as  referring  students  to 
special  programs  or  grouping  students  for  instruction,  than  for  accountability  purposes.  About 
one-third  of  principals  reported  that  district  tests  were  used  as  the  basis  for  student  promotion  or 
retention.  In  a  handful  of  schools,  district  tests  results  also  were  used  to  evaluate  teachers. 


Table  14 

Use  of  District  Assessments 

(percent  of  principals  whose  districts  administer  additional  tests) 


Use  of  assessment 

Elementary 

school 

Middle 

school 

Referring  students  to  special  programs  (e.g., 

76 

78 

summer  school  after  school  programs) 

Grouping  students  for  instruction 

68 

69 

Public  reporting 

51 

70 

Student  grade  level  retention  or  promotion 

37 

32 

School-level  consequences  (e.g.,  assistance  for 

27 

32 

low  performing  schools) 

Teacher  evaluation 

17 

14 

Principals  held  mixed  opinions  about  the  factors  that  affected  WASL  scores.  Over  90 
percent  of  principals  believed  that  teachers  needed  to  change  their  practices  to  improve  student 
performance,  and  that  better  classroom-based  assessments  would  lead  to  improved  WASL  scores 
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in  the  future.  However,  about  three-quarters  of  principals  believed  that  better  test  preparation 
was  responsible  for  most  WASL  score  gains  in  the  past  (see  Table  15).  While  most  principals 
credited  test  preparation  with  helping  to  raise  scores,  only  about  40  percent  thought  it  was  easy 
to  raise  WASL  scores  by  focusing  on  a  few  specific  skills.  Two-thirds  of  principals  believed  that 
the  WASL  tests  were  of  appropriate  difficulty,  and  a  similar  number  believed  differences  from 
one  cohort  of  students  to  the  next  made  it  difficult  to  prepare  students  properly.  Less  than  one- 
half  thought  that  sufficient  accommodations  were  provided  for  students  with  special  needs. 


Table  15 

Principals’  Opinions  About  WASL  Scores  and  Assessments 

(percent  of  principals  who  somewhat  agree  or  strongly  agree) 


Statement 

Elementary 

school 

Middle 

school 

Teachers  need  to  change  their  teaching  practices 
to  support  the  Washington  education  reform 

98 

94 

Better  classroom-based  assessments  will  lead  to 
improved  WASL  scores 

92 

94 

Better  test  preparation  is  responsible  for  most 
WASL  score  gains 

69 

82 

The  WASL  tests  are  of  appropriate  difficulty  for 
the  tested  grade  levels 

67 

60 

Differences  in  student  characteristics  from  year  to 
year  make  it  difficult  to  prepare  students  for 
WASL 

67 

59 

The  WASL  tests  permit  sufficient 

accommodations  for  students  with  disabilities 
and  Limited  English  Proficient  students 

42 

41 

There  has  been  little  focus  on  classroom  based 
assessments  because  scores  from  these 
assessments  are  not  reported 

35 

49 

It  is  easy  to  raise  student  WASL  scores  by 
focusing  on  a  few  specific  skills 

39 

40 

It  is  interesting  to  see  how  responsibility  for  decisions  related  to  the  education  reform 
were  divided  among  district,  school,  and  classroom  staff  (see  Tables  16  and  17).  According  to 
principals,  district  administrators  or  district  committees  were  almost  always  responsible  for 
textbook  selection.  In  more  than  one-half  of  the  cases  they  were  also  responsible  for  aligning 
curriculum  with  the  EALRs.  School  principals  and  district  administrator  shared  the 
responsibility  for  providing  information  to  teachers  about  the  EALRs  and  WASL.  Decisions 
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regarding  professional  development  and  allocating  professional  development  resources  were 
most  often  made  by  school  leadership  teams  or  by  school  principals.  Classroom  teachers  most 
often  retained  the  responsibility  for  developing  classroom-based  assessments.  These  patterns 
were  similar  in  elementary  and  middle  schools. 

Table  16 

Primary  Responsibility  for  Decision-Making:  Elementary  Schools 

(percent  of  principals) 


Activity 

District 
admini¬ 
strators, 
teams  or 
committees 

School 

admini¬ 

strators 

School 

shared 

decision 

making 

teams 

Teachers 

Selecting  textbooks 

88 

0 

10 

2 

Selecting  other  instructional  materials 

25 

2 

43 

30 

Developing  classroom-based  assessments 

15 

2 

17 

66 

Planning  professional  development 

36 

11 

50 

2 

activities 

Determining  how  professional 

10 

2 

83 

4 

development  funds  are  spent 

Providing  information  to  teachers  about 

43 

43 

13 

0 

the  EALRs  and  WASL 

Aligning  curriculum  with  the  EALRs  at 

51 

4 

18 

27 

benchmark  grades 

Aligning  curriculum  with  the  EALRs  at 

56 

7 

13 

24 

other  grades 

Analyzing  WASL  results 

30 

28 

33 

9 

36 


Table  17 

Primary  Responsibility  for  Decision-Making:  Middle  Schools 

(percent  of  principals) 


Activity 

Selecting  textbooks 

Selecting  other  instructional  materials 

Developing  classroom-based  assessments 

Planning  professional  development  activities 

Determining  how  professional  development 
funds  are  spent 

Providing  information  to  teachers  about  the 
EALRs  and  WASL 

Aligning  curriculum  with  the  EALRs  at 
benchmark  grades 

Aligning  curriculum  with  the  EALRs  at 
other  grades 

Analyzing  WASL  results _ 


District 

School 

admini¬ 

shared 

strators, 

School 

decision 

teams  or 

admini¬ 

making 

committees 

strators 

teams 

Teachers 

71 

0 

24 

4 

36 

0 

20 

44 

29 

0 

22 

49 

25 

25 

50 

0 

18 

9 

73 

37 

47 

14 

2 

58 

5 

21 

16 

62 

5 

21 

12 

32 

34 

27 

7 

37 


RESULTS:  ELEMENTARY  AND  MIDDLE  SCHOOL  TEACHERS 

Approximately  two-thirds  of  the  teachers  understood  the  EALRs,  WASL  and  how  to 
align  curriculum  with  the  EALRs,  but  less  than  one-half  reported  that  they  understood 
classroom-based  assessments.  Furthermore,  about  two-thirds  of  teachers  believed  the  broad 
goals  of  the  reform  were  attainable  and  the  standards  were  appropriate. 

Most  teachers  reported  that  their  curriculum  was  aligned  with  the  EALRs  in  the  subjects 
that  were  tested  by  the  state,  but  the  degree  of  alignment  was  lower  in  subjects  that  were  not 
tested.  Three-quarters  of  the  teachers  who  use  textbooks  to  teach  writing  and  mathematics 
indicated  that  these  materials  were  aligned  with  the  EALRs,  as  well. 

Most  teachers  thought  the  education  reform  promoted  better  instruction  and  increased 
student  learning,  but  some  components  of  the  reform  were  more  influential  than  others.  Two- 
thirds  of  the  teachers  said  the  EALRs  and  the  WASL  short-answer  and  extended-response  items 
had  a  positive  impact,  while  one-half  or  fewer  said  classroom-based  assessments,  district 
assessments  or  the  WASL  multiple  choice  items  were  influential.  Locally  administered 
professional  development  was  one  of  the  most  important  influences  on  the  teaching  of  writing 
and  mathematics.  On  average,  teachers  participated  in  about  three  days  of  professional 
development  each  year,  and  about  one-half  of  this  was  related  directly  to  the  Washington 
education  reform.  In  addition,  many  teachers  served  on  school  or  district  committees  responsible 
for  implementing  parts  of  the  reform.  However,  this  professional  development  focused  on 
subjects  that  were  tested  as  part  of  WASL  far  more  than  other  subjects  addressed  in  the  EALRs. 

As  a  result  of  these  influences,  teachers  made  changes  to  curriculum  and  instruction. 
Elementary  school  teachers  increased  the  time  they  spend  on  WASL-tested  subjects  and 
decreased  the  time  they  spend  on  aspects  of  the  standards  that  were  not  tested.  Writing  teachers 
in  the  fourth  and  seventh  grades  emphasized  writing  conventions  and  the  writing  process,  which 
were  important  parts  of  writing  instruction  in  many  districts  prior  to  the  education  reform. 
However,  most  teachers  also  increased  their  emphasis  on  using  a  writing  style  appropriate  to  the 
audience  and  the  purpose  and  on  writing  for  different  purposes,  which  are  the  elements  of 
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writing  promoted  by  the  EALRs.  Both  fourth  grade  teachers  and  seventh  grade  teachers  asked 
students  to  write  on  a  daily  or  weekly  basis,  but  most  student  writing  consisted  of  short  pieces  of 
one  to  two  paragraphs.  Over  the  last  two  years,  some  teachers  increased  the  number  of  writing 
assignments  they  gave,  most  often  they  increased  the  shorter  pieces.  More  fourth  grade  teachers 
than  seventh  grade  teachers  increased  the  number  of  writing  assignments.  Teachers  also  made 
some  changes  in  their  teaching  methods,  incorporating  more  rubric-based  approaches  to  writing. 

Three-quarters  of  the  mathematics  teachers  emphasized  number  sense  on  a  weekly  or 
daily  basis,  which  was  much  more  than  any  other  content  area.  However,  in  response  to  the 
reform,  almost  one-half  of  the  teachers  increased  the  emphasis  they  gave  to  probability  and 
statistics.  Most  teachers  emphasized  most  of  the  mathematical  processes  that  are  delineated  in 
the  EALRs,  and  they  increased  their  emphasis  on  analyzing  information,  investigating  situations, 
representing  and  sharing  information,  and  drawing  conclusions  and  verifying  results. 

Elementary  school  teachers  reported  greater  changes  in  mathematics  curriculum  than  middle 
school  teachers.  While  mathematics  teaching  methods  did  not  change  much,  the  majority  of 
teachers  said  they  increased  the  frequency  of  open-response  questions  with  many  right  answers. 
Students  also  were  asked  more  frequently  to  write  about  mathematics,  to  explain  their  thinking  to 
other  students,  and  to  represent  things  in  graphs. 

Teachers  had  mixed  opinions  about  the  WASL  and  WASL  scores.  Many  thought  the  test 
was  not  of  appropriate  difficulty.  Many  also  thought  test  score  changes  were  due  primarily  to 
test  preparation  activities  and  changes  in  the  students  from  year  to  year.  Nevertheless,  teachers 
have  taken  many  steps  to  improve  WASL  scores.  These  include  activities  designed  to  promote 
mastery  of  elements  of  the  EALRs  as  well  as  activities  that  focus  more  narrowly  on  the  format 
and  content  of  the  test. 

Teachers’  Understanding  of  Education  Reform 

The  majority  of  teachers  reported  that  they  understood  the  EALRs,  WASL  and 
curriculum  alignment  either  well  or  very  well,  but  less  than  one-half  reported  similar  levels  of 
understanding  about  classroom-based  assessments.  As  Table  18  shows,  80  percent  or  more  of 
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the  teachers  thought  they  understood  the  WASL  well,  while  60  percent  or  more  indicated  they 
understood  the  EALRs  and  curriculum  alignment.  Despite  the  fact  that  the  EALRs  were 
developed  and  circulated  first,  WASL  appears  to  have  garnered  more  of  teachers’  attention. 
Fourth  grade  teachers  were  somewhat  more  familiar  with  the  reform  than  seventh  grade  teachers, 
as  might  be  expected  since  elementary  teachers  have  had  one  more  year  of  exposure  to  the 
WASL. 


Table  18 

Teachers’  Understanding  of  Education  Reform 

(percent  of  teacher  who  understand  well  or  very  well) 


Aspect  of  reform 

Fourth 

grade 

teachers 

Seventh 

grade 

writing 

teachers 

Seventh 

grade 

mathematics 

teachers 

Washington  student  assessment  (WASL) 

94 

80 

84 

Essential  learnings  and  benchmarks  (EALRs) 

86 

76 

68 

Aligning  curriculum  and  instruction  with 
EALRs 

78 

68 

63 

Classroom-based  assessments  (e.g.,  Stiggins 
training,  assessment  Tool  Kits) 

55 

43 

41 

Fewer  teachers  reported  that  they  understood  classroom-based  assessment  well.  The 
percentage  of  teachers  who  understood  classroom-based  assessment  was  20  to  25  points  lower 
than  the  percentage  who  understood  the  other  aspects  of  the  reform.  This  pattern  was  consistent 
with  the  relative  emphasis  that  classroom-based  assessment  received  in  teachers’  professional 
development  (see  below). 

Teachers  endorsed  the  broad  goals  of  the  reform  and  way  they  were  operationalized  in 
the  standards.  As  Table  19  shows,  more  than  one-half  of  the  teachers  believed  the  goals  of  the 
reform  were  attainable  and  believed  the  standards  set  by  the  EALRs  were  appropriate  for  the 
benchmark  grade  levels.  However,  a  sizable  minority  of  teachers — more  than  one- 
third — disagreed.  Fourth  grade  teachers  who  had  the  most  exposure  to  the  WASL  tests  were  the 
most  cautious.  Only  60  percent  thought  the  EALRs  were  appropriate  for  fourth  grade,  and  only 
one-half  thought  the  goals  were  attainable.  Seventh  grade  mathematics  teachers  were  also  very 
concerned  with  the  goals  of  reform;  fewer  than  one-half  believed  the  goals  were  attainable. 
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Table  19 

Teachers’  Opinions  About  Reform  Goals 

(percent  of  teachers  who  somewhat  agree  or  strongly  agree) 


Statement 

Fourth 

grade 

teachers 

Seventh 

grade 

writing 

teachers 

Seventh 

grade 

mathematics 

teachers 

The  EALRs  are  appropriate  for  the  benchmark 
grade  levels  (grades  4, 7  and  10) 

61 

67 

64 

The  goals  of  Washington’s  education  reform  are 
attainable  (e.g.,  all  students  will  be  able  to 
think  analytically,  logically  and  creatively) 

51 

66 

44 

Teachers  had  access  to  many  sources  of  information  about  the  education  reform,  but  most 
teachers  learned  about  the  reform,  at  least  in  part,  through  formal  professional  development. 
Teachers  participated  in  a  substantial  amount  of  professional  development  in  the  last  two  school 
years  (1997-98  and  1998-99).  The  median  number  of  hours  of  professional  development  during 
these  two  years  was  50  hours,  approximately  three  full  days  each  school  year.  Approximately 
one-half  of  this  training  was  related  directly  to  the  Washington  education  reform  (50  percent  for 
fourth  grade  teachers  and  seventh  grade  math  teachers,  44  percent  for  seventh  grade  writing 
teachers). 

In  addition,  many  teachers  served  on  district  or  school  committees  responsible  for 
planning  or  implementing  educational  reform. 7  Table  20  shows  that  about  one-half  or  more  of 
the  teachers  were  involved  in  school-level  committees  and  about  one-quarter  or  more  were 
involved  in  district  level  committees.  The  greatest  percentage  of  teachers  served  on  committees 
devoted  to  classroom-based  assessments.  Many  teachers  also  served  on  local  committees 
working  on  aligning  curriculum  and  instruction  with  the  EALRs  and  developing  WASL-related 
materials.  A  much  smaller  percentage  teachers  were  involved  with  committees  working  directly 
on  accountability.  This  is  to  be  expected  since  the  accountability  provisions  of  the  state  reform 
were  still  under  development.  The  percentage  of  fourth  grade  teachers  who  served  on 
committees  at  either  level  was  higher  than  the  percentage  of  seventh  grade  mathematics  teachers 


7  Only  a  few  teachers  in  our  sample  served  on  committees  at  the  state  level. 
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or  seventh  grade  writing  teachers.  This  is  may  be  related  to  the  earlier  administration  of  the 
WASL  in  fourth  grade. 


Table  20 

Teacher  Service  on  Committees  Related  to  Education  Reform 

(percent  of  teachers  reporting  participation) 

Fourth  Seventh  grade  Seventh  grade 

grade  writing  mathematics 

teachers  teachers  teachers 


Committee _ District  School  District  School  District  School 


Preparing  materials  related  to 
classroom  based  assessment 

16 

69 

16 

56 

22 

53 

Aligning  curriculum  and 
instruction  with  EALRs 

37 

52 

26 

51 

31 

60 

Developing  EALRs  or  related 
materials 

28 

37 

24 

33 

27 

46 

Developing  WASL  or  related 
materials 

8 

39 

5 

30 

14 

30 

Developing  accountability 
system 

7 

34 

8 

28 

8 

27 

Alignment  of  Standards  and  Curriculum 

Most  teachers  reported  that  their  curriculum  and  their  instructional  materials  were 
somewhat  well  or  very  well  aligned  with  the  EALRs.  Figure  6  shows  teachers’  responses  to 
questions  about  alignment  in  all  the  subjects  for  which  there  are  EALRs.  About  one-quarter  of 
fourth  grade  teachers  and  seventh  grade  writing  teachers  indicated  that  their  writing  curriculum 
was  aligned  with  the  EALRs.  A  slightly  lower  percentage  of  teachers  found  their  mathematics 
curriculum  to  be  aligned  with  the  EALRs. 

Teachers  also  reported  that  their  instructional  materials  were  well  aligned  with  the 
EALRs.  In  writing,  slightly  more  than  one-half  of  the  fourth  grade  teachers  (55  percent)  and 
about  three-quarters  (74  percent)  of  the  seventh  grade  writing  teachers  indicated  that  they  used  a 
writing  or  language  arts  textbook.  Approximately  one-quarter  of  these  teachers  indicated  that 
their  writing  textbook  was  very  well  aligned  with  the  EALRs.  A  similar  degree  of  alignment 
was  reported  for  mathematics  materials.  Almost  all  fourth  grade  teachers  (93  percent)  and  the 
seventh  grade  mathematics  teachers  (89  percent)  used  a  mathematics  textbook.  Of  these,  16 
percent  indicated  that  their  textbook  was  very  well  aligned  with  the  EALRs  in  mathematics. 
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Figure  6 

Alignment  of  Curriculum  with  EALRs 

(percent  of  those  who  teach  subject  reporting  very  well  aligned) 


Almost  all  teachers  believed  they  understood  the  content  they  needed  to  know  to  prepare 
students  to  succeed  on  WASL.  Eighty  percent  of  fourth  grade  teachers,  87  percent  of  seventh 
grade  writing  teachers  and  88  percent  of  seventh  grade  mathematics  teachers  agreed  or  strongly 
agreed  that  they  had  adequate  knowledge  of  content  to  meet  the  demands  of  WASL. 

Influence  of  Reform  Elements 

Most  teachers  felt  that  reforms  promoted  better  instruction  and  increased  student 
learning;  however,  teachers  found  some  aspects  of  the  reform  more  influential  than  others  (see 
Table  21).  For  example,  about  two-thirds  of  teachers  said  the  EALRs  and  the  WASL  short 
answer  and  extended  response  items  contributed  to  better  instruction  and  increased  student 
learning.  Seventh  grade  writing  teachers  gave  particularly  high  ratings  to  WASL  extended 
responses  and  short-answer  items.  The  percent  of  teachers  who  said  those  elements  promoted 
better  instruction  "a  great  deal"  was  over  40  percent  for  WASL  extended-response  and  over  25 
percent  for  WASL  short-answer.  Fewer  teachers  believed  that  the  WASL  multiple  choice  items, 
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classroom-based  assessments  or  district  assessments  promoted  improved  teaching  and  learning. 
In  particular,  less  than  one-third  of  the  seventh  grade  mathematics  teachers  thought  that  WASL 
multiple  choice  items  or  classroom-based  assessments  promoted  better  instruction. 


Table  21 

Degree  to  Which  Reform  Elements  Promoted 
Better  Instruction  and  Increased  Student  Learning 

(percent  of  teachers  reporting  a  moderate  amount  or  a  great  deal) 


Aspect  of  reform 

Fourth 

grade 

teachers 

Seventh 

grade 

writing 

teachers 

Seventh 

grade 

mathematics 

teachers 

EALRs 

68 

68 

50 

WASL  short  answer  items 

68 

67 

61 

WASL  extended  response  items 

67 

72 

70 

WASL  multiple  choice  items 

50 

44 

32 

Classroom-based  assessments  (e.g., 

Stiggins  training,  assessment  Tool  Kits) 

53 

43 

29 

District  assessments 

41 

55 

28 

Two-thirds  of  the  teachers  said  they  needed  to  change  their  teaching  practices  to  support 
the  education  reform  (see  Table  22).  They  also  said  the  reforms  reinforced  the  changes  they 
were  already  in  the  process  of  making. 


Table  22 

Opinions  About  Education  Reform 

(percent  of  teachers  who  somewhat  agree  or  strongly  agree) 


Statement 

Fourth 

grade 

teachers 

Seventh 

grade 

writing 

teachers 

Seventh 

grade 

mathematics 

teachers 

Washington’s  education  reform  encourages 
me  to  make  the  changes  that  I  was  already 
in  the  process  of  making 

68 

79 

61 

I  need  to  change  my  teaching  practices  to 

67 

61 

63 

support  Washington’s  education  reform 


Teachers  responded  differently  to  various  elements  of  the  Washington  education  reform. 
Table  23  illustrates  the  relative  impact  of  aspects  of  the  Washington  education  reform  on  the 
content  and  teaching  of  writing.  The  state-administered  WASL  test  and  the  WASL  scores 
appeared  to  be  the  most  influential  factors.  About  three-quarters  of  writing  teachers  in  both 
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grade  levels  reported  that  WASL  had  a  moderate  or  a  great  deal  of  influence  on  changes  in  their 
writing  instruction.  A  similar  proportion  said  that  their  schools’  WASL  scores  contributed  to 
making  changes  in  their  writing  program.  In  fact,  all  the  state-administered  aspects  of  the 
Washington  education  reform  (including  WASL,  EALRs,  and  classroom-based  assessments)  had 
a  moderate  amount  of  influence  for  more  than  one-half  of  the  teachers. 

Locally  administered  professional  development  was  one  of  the  most  important  influences 
on  teachers’  responses  to  the  Washington  education  reform.  Two-thirds  of  writing  teachers  in 
both  grade  levels  said  professional  development  had  a  moderate  or  great  deal  of  influence  on 
their  writing  instruction.  However,  district-level  reforms  were  somewhat  less  influential.  About 
one-half  of  the  teachers  said  their  district  standards  and  their  locally  administered  district 
assessments  influenced  their  writing  teaching.  This  result  is  consistent  with  the  lower  frequency 
of  district  writing  tests.  Only  about  40  percent  teachers  (35  percent  of  fourth  grade  teachers  and 
44  percent  of  seventh  grade  writing  teachers)  reported  that  their  district  administered  its  own 
assessment  of  writing  at  their  grade  level. 


Table  23 

Influences  on  Writing  Lessons  and  Instruction 

(percent  of  teachers  indicating  a  moderate  amount  or  a  great  deal) 


Aspect  of  Washington  education  reform 

Grade  4 

Grade  7 

WASL 

75 

76 

In-service  training  or  formal  professional  development 
on  methods  of  teaching  writing 

66 

66 

Scores  on  WASL  tests 

64 

73 

Classroom-based  assessments 

65 

60 

EALRs 

64 

66 

District  standards 

53 

56 

District  assessments 

45 

53 

In  comparison,  most  mathematics  teachers  indicated  that  WASL  extended  response  items 
had  the  greatest  impact  on  their  teaching,  followed  by  the  WASL  short  answer  items  and  WASL 
scores  (see  Table  24).  Multiple  choice  items  on  the  WASL  were  the  least  influential  of  the  state 
and  district  reforms.  Fewer  than  one-half  of  teachers  found  WASL  multiple  choice  items  to  have 
moderate  or  great  influence.  Seventy-one  percent  of  the  fourth  grade  teachers  regarded  the 
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EALRs  as  at  least  moderately  influential,  but  barely  one-half  of  the  seventh  grade  teachers 
regarded  the  EALRs  as  influential. 

As  with  writing,  locally  administered  professional  development  in  mathematics  had  a 
moderate  or  a  great  deal  of  influence  for  nearly  two-thirds  of  the  teachers.  Fewer  teachers  found 
district-level  reforms  to  be  influential.  Although  more  than  half  of  teachers  reported  that  district 
standards  influenced  their  mathematics  curriculum  and  instruction,  only  about  40  percent 
indicated  that  district  assessments  were  at  least  moderately  influential.  Only  42  percent  of  fourth 
grade  teachers  and  46  percent  of  seventh  grade  teachers  reported  that  their  district  administered 
its  own  tests  in  mathematics. 


Table  24 

Influences  on  Mathematics  Lessons  and  Instruction 

(percent  of  teachers  indicating  a  moderate  amount  or  a  great  deal) 


Aspect  of  Washington  education  reform 

Grade  4 

Grade  7 

WASL  extended  response  items 

86 

85 

WASL  short  answer  items 

76 

76 

Scores  on  WASL  tests 

75 

71 

EALRs 

71 

52 

Classroom-based  assessments 

69 

58 

In-service  training  or  formal  professional  development 
on  methods  of  teaching  writing 

62 

64 

District  standards 

60 

61 

WASL  multiple  choice  items 

45 

41 

District  assessments 

45 

38 

Actions  in  Response  to  Education  Reform 

Teachers  responded  to  the  reform  in  a  variety  of  ways,  including  participating  in  focused 
professional  development.  Overall,  about  one-half  of  the  teachers  agreed  that  the  education 
reform  led  to  valuable  professional  development  opportunities.  Seventh  grade  writing  teachers 
were  most  positive  in  this  regard.  Sixty-four  percent  of  seventh  grade  writing  teachers  credited 
the  reform  with  creating  new  professional  development  opportunities  compared  to  46  percent  of 
fourth  grade  teachers  and  50  percent  of  seventh  grade  mathematics  teachers. 

In  terms  of  content  areas,  most  of  the  professional  development  that  teachers  participated 
in  focused  on  the  subjects  tested  on  WASL  or  on  the  state  norm-referenced  test,  i.e., 
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mathematics,  writing  and  reading  (see  Table  25).  Fewer  than  one-quarter  of  the  teachers 
participated  in  professional  development  that  emphasized  social  studies,  science,  arts,  or  health 
and  fitness.  Listening  is  the  only  tested  subject  that  was  not  a  major  focus  of  teachers’ 
professional  development.  Conversations  with  Washington  educators  suggest  this  may  have 
been  due  to  the  brevity  of  the  WASL  listening  test  and  to  early  indications  that  students  were 
mastering  the  listening  requirements. 


Table  25 

Emphasis  of  Professional  Development  on  Content  Areas 

(percent  of  teachers  reporting  a  moderate  amount  or  a  great  deal  of  emphasis) 


Content  areas 

Fourth 

grade 

teachers 

Seventh  grade 
writing 
teachers 

Seventh  grade 
mathematics 
teachers 

Reading 

79 

60 

40 

Writing 

81 

73 

48 

Mathematics 

68  • 

9 

72 

Communication/listening 

12 

31 

20 

Social  studies 

5 

13 

5 

Science 

16 

4 

15 

Arts 

8 

2 

0 

Health  and  fitness 

2 

0 

2 

In  general,  teachers  were  satisfied  with  the  quality  of  their  content  area  professional 
development.  In  fact,  a  sizable  percentage  of  teachers — about  one-third — rated  the  training  they 
received  in  WASL-tested  subjects  as  excellent  (see  Table  26).  The  majority  of  teachers 
(between  51  percent  and  73  percent)  rated  the  quality  of  the  training  in  every  subject  as  average. 

Teachers  also  reported  on  their  participation  in  professional  development  that  focused  on 
the  elements  of  the  educational  reform — assessments  and  curriculum  alignment  (see  Table  27). 
Approximately  one-half  of  the  teachers  reported  that  their  professional  development  activities 
focused  either  a  moderate  amount  or  a  great  deal  on  WASL  in  the  subject(s)  they  teach.  Almost 
as  many  reported  a  moderate  or  strong  professional  development  focus  on  aligning  curriculum 
and  instruction  with  the  EALRS.  A  much  lower  percentage  of  the  teachers  (between  one-quarter 
and  one-third)  participated  in  professional  development  that  emphasized  district  assessments  or 
classroom-based  assessments. 
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Table  26 

Quality  of  Professional  Development  in  Content  Areas 

(percent  of  teachers  reporting  excellent) 


Content  areas 

Fourth 

grade 

teachers 

Seventh  grade 
writing 
teachers 

Seventh  grade 
mathematics 
teachers 

Reading 

23 

46 

23 

Writing 

33 

39 

18 

Mathematics 

33 

— 

31 

Communication/listening 

— 

15 

7 

Social  studies 

— 

_ 

_ 

Science 

— 

_ 

_ 

Arts 

_ 

_ 

_ 

Health  and  fitness 

— 

_ 

_ 

Note:  Quality  ratings  for  a  subject  were  omitted  when  fewer  than  20  percent  of  the 
teachers  participated  in  professional  development  that  emphasized  that  subject. 


Table  27 

Emphasis  of  Professional  Development  on  Reform  Components 

(percent  of  teachers  reporting  a  moderate  or  a  great  deal  of  emphasis) 


Fourth  Seventh  grade  Seventh  grade 

grade  writing  mathematics 

Topic _ teachers _ teachers _ teachers 


WASL  in  reading 

47 

56 

32 

WASL  in  writing 

53 

66 

50 

WASL  in  mathematics 

46 

12 

60 

WASL  in  listening 

11 

27 

12 

Classroom-based  assessments 

31 

32 

20 

District  assessments 

27 

37 

32 

Aligning  curriculum  and 
instruction  with  EARLs 

42 

47 

61 

The  majority  of  teachers  rated  professional  development  related  to  assessments  and 
curriculum  alignment  as  average  (50  percent  to  80  percent).  Table  28  shows  the  percentage  of 
teachers  who  rated  each  type  of  professional  development  as  excellent.  Seventh  grade  writing 
teachers  were  much  more  satisfied  with  professional  development  related  to  the  WASL  in 
reading  and  writing  than  any  other  teachers  or  any  other  subjects.  In  fact,  a  sizable  minority  of 
seventh  grade  mathematics  teachers  (38  percent)  rated  professional  development  regarding 
classroom-based  assessment  as  poor. 

Use  of  Instructional  Time.  Among  fourth  grade  teachers  who  teach  all  subjects,  the 
allocation  of  instructional  time  appeared  to  be  influenced  by  the  state  testing  program  more  than 
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the  state  standards.  Figure  7  shows  that  teachers  spent  a  majority  of  their  instructional  time — 63 
percent — on  the  tested  subject  areas  of  reading,  mathematics  and  writing.  The  median  total 
number  of  hours  per  week  devoted  to  all  subjects  was  25  hours.  Among  the  non-tested  subjects, 
social  studies  received  the  most  attention,  with  one-half  of  fourth  grade  teachers  spending  at  least 
three  hours  each  week  on  social  studies.  Other  subjects  received  less  attention:  one-half  of 
fourth  grade  teachers  spent  no  more  than  two  hours  on  science  each  week,  and  one-half  of  fourth 
grade  teachers  spent  less  than  one  hour  each  week  on  arts  and  health  and  fitness.  This  occurred 
despite  the  fact  that  there  are  state  standards  in  these  subjects  and  teachers  reported  that  they  had 
access  to  curriculum.7 


Table  28 

Quality  of  Professional  Development  on  Assessment  and  Alignment 

(percent  of  teachers  reporting  excellent) 


Fourth  Seventh  grade  Seventh  grade 

grade  writing  mathematics 


Topic _  teachers _ teachers _ teachers 


WASL  in  reading 

13 

43 

15 

WASL  in  writing 

18 

45 

15 

WASL  in  mathematics 

13 

— 

27 

WASL  in  listening 

— 

9 

— 

Classroom-based  assessments 

12 

25 

17 

District  assessments 

9 

8 

13 

Aligning  curriculum  and 
instruction  with  EARLs 

12 

18 

11 

Note:  Quality  ratings  were  omitted  when  fewer  than  20  percent  of  the  teachers 
participated  in  professional  development  that  emphasized  that  subject 


Changes  in  Instructional  Emphasis.  Teachers  increased  the  time  they  spent  on  tested 
subjects  during  the  past  two  years,  while  decreasing  the  time  they  spent  on  the  non-tested 
subjects  (see  Figure  8).  Although  about  one-quarter  of  the  teachers  increased  the  time  they  spent 
on  communications/listening,  the  total  amount  of  instructional  time  devoted  to  this  subject  is  still 
relatively  low. 


7  More  than  90  percent  of  fourth  grade  teachers  reported  having  adequate  curriculum  for  all  subjects. 
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Figure  7 

Instructional  Emphases  Across  Subjects 

(percent  of  instructional  time  allocated  to  each  subject; 
median  hours  per  subject  in  parentheses) 
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Figure  8 

Change  in  Instructional  Emphases  Across  Subjects 

(percent  of  teachers  indicating  change) 
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Impact  on  Writing  Content,  Teaching  Strategies,  and  Activities.  Most  writing 
teachers  in  the  fourth  and  seventh  grades  reported  that  they  changed  the  overall  content  of  their 
writing  lessons  and  their  teaching  methods  over  the  last  two  years.  At  fourth  grade,  42  percent 
of  teachers  changed  their  writing  pedagogy  and  content  a  great  deal,  and  81  percent  of  teachers 
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reported  making  at  least  a  moderate  amount  of  change.  Fewer  seventh  grade  writing  teachers 
made  changes:  29  percent  reported  a  great  deal  of  change  and  55  percent  reported  at  least  a 
moderate  amount  of  change. 

The  content  of  the  writing  curriculum  is  broadly  reflective  of  the  EALRs  in  both  the 
fourth  and  seventh  grades.  Eleven  of  the  14  writing  behaviors  specified  in  the  EALRS  are 
covered  weekly  or  more  often  by  over  40  percent  of  the  teachers  in  both  grade  levels  (see  Figure 
9).  However,  teachers  concentrated  classroom  time  more  on  writing  conventions  and  on  the 
writing  process  than  on  the  other  elements  of  the  EALRs.  Over  80  percent  of  teachers  in  both 
grades  addressed  the  application  of  writing  conventions  at  least  weekly.  All  the  elements  of  the 
writing  process  except  publishing  (i.e.,  pre-write,  draft,  revise,  edit  publish)  were  covered  at  least 
weekly  by  more  than  two-thirds  of  the  fourth  grade  teachers  and  more  than  one-half  of  the 
seventh  grade  writing  teachers.  Teachers  in  both  grade  levels  focused  less  often  on  writing  for 
different  purposes,  different  audiences,  writing  in  different  forms,  and  writing  for  career 
applications,  which  are  the  less-traditional  aspects  of  the  writing  EALRs.  Thus,  the  writing 
content  most  frequently  taught  might  be  considered  more  “traditional”  and  the  content  taught 
less  frequently  might  be  considered  more  “reform-oriented.” 

Figure  9 

Frequency  of  Coverage  of  Writing  EALRs 

(percent  of  teachers  covering  aspect  weekly  or  daily) 
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Teachers  also  reported  that  they  were  changing  their  emphasis  on  writing  topics,  and  the 
greatest  increases  in  coverage  were  for  the  less-traditional  topics  (see  Figure  10).  Roughly  one- 
half  of  the  teachers  in  both  grade  levels  reported  increasing  their  coverage  of  different  audiences, 
purposes,  and  forms  of  writing,  as  well  as  the  application  of  styles  appropriate  to  different 
audiences  and  purposes.  These  are  the  elements  of  writing  emphasized  by  the  WASL.  About 
one-third  increased  coverage  of  the  most  frequently  covered  EALRs,  suggesting  that  teachers’ 
emphasis  on  writing  conventions  and  the  writing  process  preceded  the  reform. 

Figure  10 

Increase  in  Frequency  of  Coverage  of  Writing  EALRs 

(percent  of  teachers  indicating  an  increase) 
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Teachers  were  also  changing  the  methods  they  used  to  teach  writing.  Teachers  reported 
the  frequency  with  which  they  used  15  different  instructional  strategies  ranging  from  fairly 
traditional  techniques,  e.g.,  "read  orally  to  students,"  to  more  innovative  approaches,  e.g.,  "write 
with  students  on  the  same  assignment"  (see  Figure  11).  Most  teachers  in  both  grades  read  to 
students  at  least  once  a  week  and  taught  language  mechanics  (grammar,  spelling,  punctuation 
and  syntax)  as  frequently.  More  than  one-half  of  the  teachers  taught  about  word  choice  and 
helped  students  revise  their  work  on  a  weekly  or  daily  basis. 
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Some  teaching  strategies  were  not  used  frequently  by  many  teachers.  Few  teachers  in 
either  grade  regularly  used  WASL  rubrics  to  comment  on  student  writing,  held  conferences  with 
students  about  their  writing,  or  wrote  along  with  students  on  the  same  assignment.  More  than  10 
percent  of  teachers  never  wrote  with  students  on  the  same  assignment. 

Figure  11 

Frequency  of  Use  of  Selected  Teaching  Strategies  in  Writing 

(percent  of  teachers  using  strategy  weekly  or  daily) 


More  fourth  grade  teachers  were  likely  to  read  orally  to  students  on  a  daily  or  weekly 
basis  than  seventh  grade  teachers.  Fourth  grade  teachers  were  also  more  likely  to  use  rubric- 
based  approaches  to  writing  frequently;  over  60  percent  of  fourth  grade  teachers  taught  “six  trait” 
or  other  rubric-based  approaches  to  writing  at  least  weekly  compared  to  about  40  percent  of 
seventh  grade  writing  teachers.  Regular  time  for  unstructured  “free”  writing  and  for  pre- writing 
activities  was  also  somewhat  more  common  among  fourth  than  seventh  grade  teachers. 

The  greatest  changes  in  writing  instruction  were  related  to  the  use  of  rubrics:  teaching 
Six-Trait  or  other  rubric-based  approaches  and  commenting  on  student  writing  in  terms  of 
WASL  rubrics.  As  Figure  12  shows,  the  majority  of  teachers  in  both  grade  levels  increased  their 
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use  of  these  two  strategies  for  teaching  writing.  One-quarter  to  one-third  of  the  teachers  reported 
increasing  their  use  of  many  of  the  other  strategies  as  well.  A  handful  of  teachers  decreased  the 
time  they  devoted  to  unstructured,  “free”  writing:  19  percent  of  fourth  grade  teachers  and  15 
percent  of  seventh  grade  writing  teachers.  For  most  of  the  teaching  techniques  in  the  survey  the 
degree  of  change  was  similar  among  fourth  grade  teachers  and  seventh  grade  writing  teachers. 
The  one  exception  was  explaining  mechanics  and  reading  orally  to  students;  more  seventh  grade 
teachers  than  fourth  grade  teachers  increased  the  frequency  of  reading  orally  to  students. 

Overall,  more  teachers  reported  changing  how  writing  was  taught  (i.e.,  strategy)  than  what  was 
taught  (i.e.,  content). 

Figure  12 

Increase  in  Use  of  Selected  Teaching  Strategies  in  Writing 

(percent  of  teachers  indicating  an  increase) 


Writing  teachers  gave  students  regular  writing  assignments,  but  most  of  the  writing 
assignments  were  short  pieces,  one  to  two  paragraphs  in  length.  Eighty-five  percent  of  fourth 
grade  teachers  and  91  percent  of  seventh  grade  writing  teachers  reported  that  their  students 
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produced  these  short  written  works  on  a  weekly  or  daily  basis.  Sixty-three  percent  of  teachers 
indicated  that  students  produced  mid-length  pieces  (one  to  two  pages  length)  only  once  or  twice 
a  month.  Over  one-half  of  the  teachers  indicated  that  students  wrote  long  pieces  (three  or  more 
paragraphs  in  length)  only  once  or  twice  a  semester.  The  length  of  the  written  work  increased  as 
student  grew  older.  Fourth  grade  students  were  asked  to  write  shorter  pieces  (one  to  two 
paragraphs)  slightly  more  frequently  than  seventh  grade  students,  but  seventh  grade  students 
were  asked  to  write  longer  pieces  (three  or  more  pages)  more  often  than  fourth  grade  students. 

The  amount  of  written  work  increased  during  the  past  two  years,  but  most  of  the  increase 
was  in  the  form  of  short  pieces.  More  teachers  in  both  grade  levels  increased  the  frequency  of 
short  written  work  than  increased  the  frequency  of  longer  written  work.  For  example,  45  percent 
of  fourth  grade  teachers  increased  the  frequency  that  students  wrote  short  pieces  (one  to  two 
paragraphs  in  length)  compared  to  35  percent  who  increased  the  frequency  of  mid-length  pieces 
(one  to  two  pages),  and  only  20  percent  who  increased  the  frequency  of  long  written  work  (three 
pages  or  longer).  The  percentage  of  seventh  grade  teachers  who  increased  the  frequency  of 
student  written  work  was  about  five  points  lower  than  the  percentage  of  fourth  grade  teachers  in 
each  category. 

Impact  on  Mathematics  Content,  Teaching  Strategies,  and  Activities.  Washington 
mathematics  teachers  have  changed  the  content  of  their  lessons  and  the  way  they  teach 
mathematics  during  the  past  two  years.  At  fourth  grade,  44  percent  of  teachers  changed  their 
content  and  pedagogy  a  great  deal  and  84  percent  of  teachers  reported  at  least  a  moderate  amount 
of  change.  There  was  not  as  much  change  among  seventh  grade  mathematics  teachers;  only  13 
percent  of  teachers  reported  a  great  deal  of  change  and  about  two-thirds  of  reported  at  least  a 
moderate  amount  of  change. 

Of  the  five  major  content  areas  of  mathematics,  number  sense  was  covered  at  least 
weekly  by  the  greatest  number  of  teachers  (see  Figure  13).  Probability  and  statistics  is  the  topic 
covered  weekly  by  the  fewest  number  of  teachers;  fewer  than  20  percent  of  teachers  discuss  this 
topic  at  least  weekly. 
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Figure  13 

Frequency  of  Coverage  of  Mathematics  Content  Areas 

(percent  of  teachers  covering  content  weekly  or  daily) 


1.1  Number 
Sense 

1.2  Algebraic 
Sense 

1.3  Measurement 

1.4  Geometric 
Sense 

1.5  Probability 
and  Statistics 


|  ■  Grade  4 
|  Q  Grade  7 


Figure  14 

Increase  in  Coverage  of  Mathematics  Content  Areas 

(percent  of  teachers  indicating  an  increase) 


■  Grade  4 
□  Grade  7 


Furthermore,  as  Figure  14  shows,  content  emphasis  has  not  changed  dramatically  in  the 
past  two  years.  With  one  exception,  only  about  one-third  of  the  teachers  reported  increasing 
coverage  of  any  of  the  five  topics.  In  contrast,  about  one-half  of  the  mathematics  teachers 
increased  their  coverage  of  probability  and  statistics  during  the  past  two  years.  More  fourth  grade 
than  seventh  grade  teachers  increased  their  coverage  of  measurement  topics,  while  more  seventh 
grade  teachers  than  fourth  grade  teachers  increased  their  coverage  of  probability  and  statistics. 
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The  situation  was  somewhat  different  for  mathematical  processes.  Most  teachers  covered 
a  large  number  of  the  mathematical  processes  highlighted  in  the  EALRs  on  a  weekly  or  daily 
basis  (see  Figure  15).  Two-thirds  or  more  of  the  mathematics  teachers  included  analyzing 
information,  constructing  solutions,  relating  concepts  to  real  life,  and  relating  concepts  within 
mathematics  in  their  lessons  on  a  weekly  or  daily  basis.  More  fourth  grade  teachers  than  seventh 
grade  mathematics  teachers  cover  these  mathematical  processes  at  least  weekly. 

Figure  15 

Frequency  of  Coverage  of  Mathematical  Processes 

(percent  of  teachers  covering  process  weekly  or  daily) 
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Teachers  also  reported  a  substantial  increase  in  the  frequency  with  which  they  addressed 
these  mathematical  processes,  particularly  fourth  grade  teachers  (see  Figure  16).  More  than  one- 
half  of  the  fourth  grade  teachers  reported  increasing  the  frequency  with  which  they  covered  most 
of  the  processes.  In  seventh  grade,  more  than  one-half  of  the  teachers  increased  the  frequency  of 
drawing  conclusions  and  verifying  results,  investigating  solutions,  organizing  and  interpreting 
information,  and  representing  and  sharing  information.  These  elements  characterize  a  more 
problem-oriented  approach  to  mathematics. 
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Figure  16 

Increase  in  Coverage  of  Mathematical  Processes 

(percent  of  teachers  indicating  an  increase) 
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Most  mathematics  teachers  regularly  used  a  wide  range  of  instructional  strategies.  Figure 
17  shows  that  most  mathematics  teachers  in  grades  four  and  seven  regularly  used  strategies 
ranging  from  fairly  traditional  techniques,  e.g.,  “explain  new  concept,”  to  more  innovative 
approaches,  e.g.,  “ask  open-response  questions  with  many  right  answers.”  Fourth  grade  teachers 
were  much  more  likely  than  seventh  grade  mathematics  teachers  to  demonstrate  mathematical 
ideas  using  constructions  and  manipulatives  and  to  conduct  speed  drills  in  their  classrooms. 

Only  12  percent  of  seventh  grade  mathematics  teachers  used  speed  drills  regularly,  and  some 
teachers,  including  29  percent  of  seventh  grade  teachers,  never  used  speed  drills. 

With  the  exception  of  asking  open-response  questions  with  many  right  answers,  most 
mathematics  teachers  did  not  increase  the  frequency  with  which  they  used  different  strategies 
during  the  last  two  years.  However,  two-thirds  of  fourth  grade  teachers  and  more  than  one-half 
of  seventh  grade  mathematics  teachers  reported  that  they  asked  more  open-response  questions 
with  many  right  answers.  Also,  nearly  one-half  of  the  mathematics  teachers  increased  the 
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frequency  of  giving  examples  of  real-life  applications  over  the  last  two  years.  Such  questions 
more  closely  resemble  the  WASL  extended-response  items  and  the  less  traditional  elements  of 
the  EALRs.  It  is  worth  noting  that  about  20  percent  of  teachers  decreased  their  use  of  speed 
drills  during  the  past  two  years,  which  is  greater  than  the  percentage  who  increased  their  use  of 
speed  drills. 


Figure  17 

Frequency  of  Use  of  Selected  Teaching  Strategies  in  Mathematics 

(percent  of  teachers  using  strategy  weekly  or  daily) 


Conduct  speed  drills 

Demonstrate  mathematical  ideas  using  constructions, 
manipulatives,  etc. 

Ask  open-response  questions  with  many  right  answers 

Give  examples  of  real-life  applications 

Assess  students’  mathematics  skills 

Demonstrate  new  skill 

Explain  new  concept 
Explain  correct  solutions 


■  Grade  4 

■  Grade  7 


Some  of  the  changes  mathematics  teachers  made  in  their  use  of  teaching  strategies 
differed  by  grade  level.  More  fourth  grade  than  seventh  grade  teachers  had  students  demonstrate 
their  mathematics  skill  using  manipulatives,  had  students  explain  correct  solutions,  and  assessed 
students’  mathematics  skills.  Seventh  grade  teachers,  on  the  other  hand,  increased  the  amount  of 
time  they  spent  explaining  new  concepts. 

There  was  also  considerable  variation  in  the  classroom  activities  students  were  asked  to 
perform.  Almost  all  teachers  had  students  practice  computation  on  a  daily  or  weekly  basis  (see 
Figure  18).  However,  most  teachers  also  had  students  regularly  engaged  in  less  traditional 
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activities.  For  example,  most  fourth  grade  teachers  had  students  work  on  problem  solving  in 
groups  with  other  students,  explain  their  thinking  to  other  students,  and  write  about  mathematics 
at  least  once  a  week.  Most  seventh  grade  teachers  asked  students  to  use  mathematics  to  solve 
real-life  problems;  learn  mathematics  facts,  rules,  and  formulas;  and  write  about  mathematics  at 
least  weekly. 

Figure  18 

Frequency  of  Selected  Student  Learning  Activities  in  Mathematics 

(percent  of  teachers  having  students  engage  in  activity  weekly  or  daily) 


Extended  mathematics  activities 
Solve  problems  using  manipulatives 
Use  measuring  tools 
Use  mathematics  in  the  context  of  other  subjects 
Discover  concepts  for  themselves 
Take  tests  and  quizes 
Represent  concepts  or  ideas  in  tables,  graphs,  or  pictures 
Explain  thinking  to  other  students 
Work  in  groups  on  problem  solving 
Write  about  mathematics 
Learn  mathematics  fact,  rules,  or  formulas 
Solve  real-life  problems 
Practice  computation 


■  Grade  4 
□  Grade  7 


The  mathematics  lessons  students  engage  in  have  changed  over  the  last  two  years,  as 
well.  As  Figure  19  shows,  writing  about  mathematics  was  the  activity  whose  frequency  was 
increased  by  the  greatest  number  of  teachers  in  both  grades.  In  addition,  a  majority  of  teachers 
also  increased  the  amount  of  time  students  spend  explaining  their  thinking  to  other  students,  and 
representing  concepts  or  ideas  in  tables,  graphs,  or  pictures. 
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Figure  19 

Increase  in  Selected  Student  Learning  Activities  in  Mathematics 

(percent  of  teachers  indicating  an  increase) 


Extended  mathematics  activities 
Solve  problems  using  manipulatives 
Use  measuring  tools 
Use  mathematics  in  the  context  of  other  subjects 
Discover  concepts  for  themselves 
Take  tests  and  quizes 
Represent  concepts  or  ideas  in  tables,  graphs,  or  pictures 
Explain  thinking  to  other  students 
Work  in  groups  on  problem  solving 
Write  about  mathematics 
Learn  mathematics  fact,  rules,  or  formulas 
Solve  real-life  problems 
Practice  computation 
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Opinions  and  Actions  Concerning  WASL  Scores.  Mathematics  teachers  held  mixed 
opinions  about  the  appropriateness  of  WASL  and  about  the  factors  that  affected  WASL  scores. 
Only  about  one-quarter  of  fourth  grade  teachers  and  about  one-third  of  seventh  grade 
mathematics  teachers  believed  that  the  WASL  tests  were  of  the  appropriate  difficulty  for  the 
tested  grade  levels  (see  Table  29).  Furthermore,  most  teachers  agreed  that  changes  in  WASL 
scores  could  be  attributed  to  factors  that  were  unrelated  to  the  standards.  Three-quarters  of  the 
teachers  believed  that  better  test  preparation  was  responsible  for  most  of  the  changes  in  WASL 
scores.  They  also  reported  that  differences  between  successive  cohorts  of  students  were  an 
obstacle  to  preparing  students  for  WASL.  However,  less  than  one-third  of  fourth  grade  teachers 
and  seventh  grade  mathematics  teachers  believed  that  it  was  easy  to  raise  test  scores  by  focusing 
narrowly  on  a  few  specific  skills  featured  on  the  test. 
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Table  29 

Opinions  About  WASL  Scores  and  Assessments 

(percent  of  respondents  who  somewhat  agree  or  strongly  agree) 


Statement 

Fourth 

grade 

teachers 

Seventh 

grade 

writing 

teachers 

Seventh 

grade 

mathematics 

teachers 

Differences  in  student  characteristics  from 
year  to  year  make  it  difficult  to  prepare 
students  for  WASL 

73 

71 

74 

Better  test  preparation  is  responsible  for 
most  WASL  score  gains 

74 

80 

85 

Better  classroom-based  assessments  will 
lead  to  improved  WASL  scores 

69 

83 

80 

There  has  been  little  focus  on  classroom 
based  assessments  because  scores  from 
these  assessments  are  not  reported 

45 

66 

59 

The  WASL  tests  permit  sufficient 
accommodations  for  students  with 
disabilities  and  Limited  English 

Proficient  students 

27 

42 

26 

The  WASL  tests  are  of  appropriate 
difficulty  for  the  tested  grade  levels 

25 

62 

37 

It  is  easy  to  raise  student  WASL  scores  by 

21 

47 

30 

focusing  on  a  few  specific  skills 


Seventh  grade  writing  teachers  present  an  interesting  contrast.  They  were  more  likely  to 
think  that  the  WASL  was  of  an  appropriate  difficulty,  and  they  were  more  likely  to  say  that 
scores  could  be  raised  by  focusing  on  a  few  specific  skills.  These  differences  may  be  explained 
by  the  different  nature  of  the  writing  assessment,  which  consisted  of  an  extended  writing  task 
rather  than  a  series  of  shorter  questions. 

Teachers  agreed  about  the  potential  of  classroom-based  assessments  (CB  A)  to  improve 
scores,  but  indicated  that  CB  A  received  less  emphasis  because  the  scores  were  not  part  of  the 
assessment  system.  More  than  two-thirds  of  the  teachers  thought  that  better  classroom-based 
assessments  would  lead  to  improved  WASL  scores.  However,  more  than  one-half  reported  that 
they  focused  on  CB  A  less  because  the  scores  were  not  reported.  In  addition,  fewer  than  one-half 
of  teachers  believed  that  the  WASL  tests  permit  sufficient  accommodations  for  special  needs 
students  (students  with  disabilities  and  Limited  English  Proficient  students). 
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Teachers  have  taken  many  steps  to  help  students  perform  well  on  the  WASL  tests. 
Writing  teachers  indicated  more  frequent  use  of  strategies  that  focused  broadly  on  student 
writing  than  strategies  that  focused  narrowly  on  the  tests  (see  Table  30).  In  preparing  students 
for  the  WASL  test  in  writing,  more  than  half  of  teachers  used  two  activities:  six-trait  or  other 
rubric  based  approaches  to  writing  and  open-ended  questions  in  classroom  work.  Most  fourth 
grade  teachers  and  almost  one-half  of  the  seventh  grade  teachers  adopted  a  rubric-based 
approach  to  teaching  writing  at  least  once  a  week.  Three-quarters  of  seventh  grade  teachers  and 
over  one-half  of  fourth  grade  teachers  incorporated  short  answer  questions  into  classroom  work 
once  a  week  or  more  often. 


Table  30 

Frequency  of  Activities  to  Help  Students  Do  Well  on  WASL  Test  in  Writing 

(percent  of  teachers  using  activity  weekly  or  daily) 


Activity _ Grade  4 _ Grade  7 

Teach  Six-Trait  or  other  rubric-based  approach  to  writing  64  48 

Use  open-ended  questions  (short  answer  and  extended  59  77 

response)  in  classroom  work 

Display  scoring  rubrics  in  classroom  39  42 

Discuss  responses  to  WASL  or  WASL-like  items  that  29  30 

demonstrate  different  levels  of  performance 
Have  students  practice  using  items  released  from  WASL  29  14 

Have  students  score  classroom  work  using  rubrics  27  22 

Use  materials  from  assessment  Tool  Kits  24  9 


While  WASL-specific  practice  was  not  as  common  in  writing,  there  was  quite  a  bit  of  it 
in  evidence.  About  two-thirds  of  teachers  in  fourth  grade  engaged  in  narrower  practice  activities 
at  least  once  a  month.  These  activities  included  practice  with  released  items  (60  percent), 
discussion  of  responses  to  WASL  items  (63  percent),  practice  using  the  rubrics  to  score 
classroom  work  (63  percent),  and  displaying  the  scoring  rubrics  in  the  classroom  (64  percent). 
About  20  percent  fewer  seventh  grade  teachers  practiced  with  released  items  or  discussed 
responses  to  WASL  items  once  a  month  or  more. 

Teachers  were  given  an  opportunity  to  describe  other  strategies  they  used  to  prepare 
students  for  WASL  in  writing.  They  reported  a  wide  range  of  activities,  including  some  that 
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were  designed  to  foster  writing  broadly  and  others  that  appeared  to  be  narrowly  focused  on  the 
test  itself  and  others.  Narrow  reactions  included: 

“Spent  far  too  much  class  time  teaching  to  the  test  instead  of  teaching.” 

“Pray,  teach  test-taking,  teach  ‘you  must’  revise  and  rewrite.” 

Teachers’  responses  that  appeared  to  reflect  the  reform’s  intent  included: 

“I  have  incorporated  writing  in  all  subject  areas  because  of  WASL.” 

“Given  them  time  to  talk  about  writing  with  each  other  and  with  older  students.” 

Most  teachers’  comments  fell  between  these  extremes.  It  is  difficult  to  say,  in  isolation,  whether 
the  following  comments  represent  appropriate  or  inappropriate  reactions: 

‘The  district  prepares  a  task  of  the  month  for  both  reading  and  writing...  my  classes 
complete  one  per  month  in  each  area.” 

“I  have  recently  incorporated  WASL-like  assessment  in  nearly  every  unit  I  teach 
throughout  the  year.  These  assessments  include  rubrics  which  imitate  the  WASL  very 
closely.” 

“I’ve  created  user-friendly  WASL  writing  rubrics,  and  as  we  write  for  other  subjects  we 
use  the  rubrics  in  small  groups  to  assess  our  progress.” 

Mathematics  teachers  also  initiated  a  number  of  activities  to  promote  WASL  scores.  Of 
the  types  of  mathematics  test  preparation  that  we  asked  about,  only  one  was  used  frequently  by  a 
majority  of  teachers  (see  Table  31).  One-half  of  fourth  grade  teachers  and  slightly  more  than 
one-half  of  seventh  grade  teachers  reported  frequently  using  open-response  questions  in 
classroom  work  to  help  students  prepare  for  WASL.  The  state-developed  assessment  Tool  Kits 
designed  to  facilitate  better  classroom-based  assessment  were  used  less  frequently,  especially  by 
seventh  grade  teachers,  despite  many  teachers’  belief  that  better  classroom-based  assessment 
would  lead  to  increased  WASL  scores. 

More  direct  test  preparation,  such  as  having  students  practice  WASL  released  items  and 
discussing  responses  to  WASL  or  WASL-like  items,  was  less  common  but  still  occurred  at  least 
weekly  in  48  percent  of  fourth  grade  classrooms  and  28  percent  of  seventh  grade  classrooms. 


64 


About  25  percent  of  teachers  never  used  Tool  Kits  or  rubrics  (displaying  or  using  rubrics)  in  their 
mathematics  instruction. 


Table  31 

Frequency  of  Activities  to  Help  Students  Do  Well  on  WASL  Test  in  Mathematics 

(percent  of  teachers  using  activity  weekly  or  daily) 


Activity 

Grade  4 

Grade  7 

Use  open-ended  questions  (short  answer  and  extended 

62 

50 

response)  in  classroom  work 

Discuss  responses  to  WASL  or  WASL-like  items  that 

48 

28 

illustrate  different  levels  of  performance 

Have  students  practice  using  items  released  from  WASL 

42 

34 

Use  material  from  assessment  Tool  Kits 

36 

13 

Display  scoring  rubrics  in  classroom 

35 

15 

Have  students  score  classroom  work  using  rubrics 

27 

16 

In  response  to  an  open-ended  question  asking  mathematics  teachers  about  test  preparation 
activities,  teachers  indicated  that  they  prepare  students  for  WASL  using  a  range  of  strategies. 
Some  strategies  reflected  the  intent  of  the  reform,  leading  toward  a  “deeper  study  of  important 
mathematics”  (OSPI,  2000,  February  15).  Some  of  these  strategies  were  narrow,  focusing  on 
increasing  test  scores  without  developing  students’  knowledge  and  skill  of  mathematics.  Other 
strategies  fell  in  the  continuum  between  deeper  understanding  of  mathematics  and  inappropriate 
test  practice  that  artificially  inflates  scores.  Narrow  reactions  included: 

‘Take  aspirin,  attend  workshops,  correlate  EALRs,  try  to  minimize  any  damage  of 
preparing  for  WASL  test  in  lieu  of  teaching  math.  Try  not  to  neglect  other  subjects.” 
“Practice  daily  in  warm  ups  at  the  beginning  of  class  as  well  as  once  a  week,  we  have  1 
hour  of  WASL  sample  questions  for  students  to  practice  short  and  extended  response  and 
multiple  choice.” 

“Explaining  answers  and  processes  to  students,  practicing  with  students  to  watch  for  and 
avoid  tricks  and  traps.  Teaching  that  in  the  real  world  in  math,  correct  answers  are 
always  the  principal  objective  only  in  the  state  test  it  is  not.” 

Some  teachers  reported  using  strategies  that  reflected  the  intent  of  the  reforms: 
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“Increase  students’  math  vocabulary  in  order  to  discuss  in  words  or  speech  their  solutions 
to  given  problems.” 

“More  group  work,  extended  application  activities  and  more  written  explanations  of  their 
thinking  or  approach.” 

“Increased  use  of  manipulatives;  am  learning  to  use  new  materials  purchased  by  school 
district  to  teach  mathematics;  less  reliance  on  textbook.  More  emphasis  on  writing  and 
problem  solving.” 

Strategies  that  fell  between  these  extremes  of  appropriateness  included: 

“I  have  truly  stressed  basic  skills.  When  these  are  not  in  place  (and  they  often  are  not),  it 
is  impossible  to  do  well  on  the  higher-level  thinking  skills.” 

“Weekly  story  problems  graded  on  a  rubric.” 

“Keeping  math  journals  with  vocabulary  words  giving  biweekly  quizzes  that  require 
written  responses.  Started  a  problem  solving  class.” 

“I  use  4th  grade  Saxon  math  program  four  days  a  week.  One  day  a  week  is  devoted  to 
problem  solving  using  WASL  sample  questions  and  other  sources  that  require  more  in- 
depth  response.  We  compare  results  and  how  they  would  be  scored  on  the  WASL.” 

The  question  of  appropriate  test  preparation  activities  is  one  that  deserves  continued 
study  as  the  reform  continues  to  be  implemented. 
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RESULTS:  THE  EFFECT  OF  SCHOOL  AND  CLASSROOM  FEATURES 

ONWASL  SCORES 


There  were  a  small  number  of  significant  relationships  between  WASL  scores  and  the 
school  and  classroom  features  addressed  on  the  principal  and  teacher  surveys.  Table  32 
summarizes  the  results  from  four  regression  analyses  (one  for  each  subject);  the  detailed  results 
are  contained  in  Table  D.3  in  Appendix  D.  The  strongest  effects  were  related  to  the  alignment  of 
curriculum  with  the  EALRs  and  to  teachers’  understanding  of  the  reform.  For  two  of  the  four 
subjects,  WASL  scores  were  higher  in  schools  where  there  was  greater  alignment  between 
curriculum  and  the  EALRs  (as  reported  by  teachers).  Scores  were  also  higher  in  schools  where 
teachers  reported  that  they  understood  the  EALRs  and  WASL  well  (this  difference  was 
significant  for  mathematics  and  on  the  borderline  of  being  significant  for  reading).  Teaching 
experience  was  a  significant  predictor  of  scores  in  writing. 

Table  32 

Summary  of  Regression  Analyses 

(significant  positive  and  negative  effects) 


School  and  Classroom  Features 

Reading  Mathematics  Writing  Listening 

Principal  Reports 

SLIG  resources 

Presence  of  District  Standards 

Degree  of  Curriculum  Alignment 

School  Activities  to  Improve  WASL 

Teacher  Reports 

Teaching  Experience 

Test  Preparation  in  Math 

Test  Preparation  in  Writing 

Understanding  of  EALRs  and  WASL 

Degree  of  Curriculum  Alignment 

Professional  Development  on  WASL 
Professional  Development  on  Education 
reform 

+ 

+ 

+ 

++  ++ 

+  p<0.05  ++  p<0.01  -  p<0.05 

-  p<0.01 

Most  variables  we  investigated  had  no  significant  relationship  with  WASL  scores.  This 
included  the  principal’s  reports  of  school-level  actions  taken  to  support  the  education  reform.  It 
also  included  teacher  reports  concerning  test  preparation  and  professional  development  related  to 
WASL.  There  were  also  some  counter-intuitive  results  in  reading  that  are  difficult  to  explain. 
There  was  a  weak  negative  relationship  between  reading  scores  and  WASL-focused  professional 
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development  (a  negative  relationship  between  listening  scores  and  curriculum  alignment),  and 
there  was  positive  relationship  between  reading  scores  and  test  preparation  activities  in 
mathematics.  Such  unusual  results  are  not  uncommon  in  regression  analyses  that  include  many 
variables  that  are  correlated  as  these  were. 
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DISCUSSION 


This  study  paints  a  picture  of  schools  in  transition,  responding  to  a  state  reform  effort  that 
is  both  incremental  and  evolving.  The  reform  is  incremental  in  the  sense  that  the  statewide 
testing  program  is  being  implemented  gradually  according  to  a  decade-long  timetable.8  It  is 
evolving  in  the  sense  that  elements  are  changing  in  unpredictable  ways.  For  example,  the  nature 
of  state  support  for  professional  development  has  changed  annually  for  the  past  three  years.9 
Similarly,  the  accountability  system,  which  will  be  a  cornerstone  of  the  reform,  is  still  being 
designed  by  a  statewide  commission.  Also,  the  grades  tested  by  standardized  norm-referenced 
tests  have  been  fluctuating.  The  survey  results  from  principals  and  teachers  are  consistent  with 
such  a  transitional  reform  setting. 

Status  of  Implementation 

The  Washington  education  reform  resembles  standards-based  reforms  in  other  states  in  a 
number  of  key  respects.  It  was  initiated  at  the  state  level,  it  is  organized  around  a  set  of 
academic  standards  adopted  at  the  state  level,  and  success  will  be  measured  by  scores  on  a 
statewide  test  based  on  the  standards.  Like  other  states,  the  reform  focuses  on  districts  and 
schools  as  the  unit  of  accountability  rather  than  teachers  or  students  (Elmore,  Abelmann,  and 
Fuhrman,  1996).  Local  educators  are  responsible  for  developing  practices  to  help  students 
master  the  standards.  Under  these  circumstances  we  would  expect  a  pattern  of  implementation 
that  flows  “downwards”  from  the  state  to  the  districts,  from  the  district  to  the  schools,  and  then 
to  classrooms.  Responses  to  our  survey  are  quite  consistent  with  this  scenario. 

Although  test  results  are  reported  at  the  school  level,  making  schools  the  formal  unit  of 
accountability  in  the  Washington  education  reform,  districts  play  an  important  role.  Not  only  is 


8  Administration  of  the  WASL  tests  began  with  elementary-level  tests  in  reading,  writing,  listening  and 
mathematics,  which  were  available  on  a  voluntary  basis  in  1996-97.  Over  ten  years,  tests  in  these  subjects,  as  well 
as  social  studies,  science,  arts,  and  health/fitness  will  be  introduced  in  elementary,  middle  and  high  school.  The 
final  WASL  tests  to  be  phased  in  are  the  elementary-level  WASL  tests  in  arts  and  health  and  fitness,  which  will  be 
mandatory  in  2006-07  (see  Table  3). 

9  The  state  has  become  more  prescriptive  about  schools’  use  of  state  funds  allocated  for  professional 
development.  In  1998-99,  the  state  permitted  schools  to  use  funds  for  any  professional  development  related  to 
reform.  In  1999-2000,  the  state  required  districts  to  use  funds  for  three  professional  development  days.  See  page  1 1 
for  further  discussion  of  professional  development. 
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there  a  tradition  of  strong  district  control  in  the  state,  but  policies  established  at  the  district  level 
are  germane  to  the  success  of  the  reform.  Districts  are  responsible  for  standards,  curriculum, 
assessments,  promotion/retention  rules,  report  cards,  and  other  policies  that  send  messages  to 
principals  and  teachers  about  priorities.  Research  shows  that  when  district  and  state  policies 
conflict,  teachers  receive  multiple  messages  that  may  reduce  their  effectiveness  (Smith  and 
O’Day,  1991). 

It  appears  that  districts  have  been  quick  to  make  their  policies  consistent  with  the  state 
reform.  In  particular,  most  principals  indicated  that  their  districts  have  either  developed  or 
revised  their  academic  standards  since  the  EALRs  and  WASL  were  introduced.  Also,  most 
reported  that  district  standards  were  aligned  with  EALRs  in  the  WASL-tested  subjects  (reading, 
mathematics,  writing,  and  listening).  Somewhat  fewer  principals,  though  still  a  majority,  said 
that  their  district  standards  were  aligned  with  EALRs  in  the  non-tested  subjects  (social  studies, 
science,  art,  and  health  and  fitness).  Districts  have  also  changed  their  assessment  requirements 
in  light  of  the  reform,  and  principals  believed  their  district  tests  were  aligned  with  the  WASL. 

Rapid  changes  have  been  made  at  the  school  level,  as  well.  During  the  past  two  years 
principals  and  teachers  devoted  considerable  effort  to  learning  about  the  reform  and  adapting 
school  practices  to  support  it.  Both  principals  and  teachers  participated  in  professional 
development  activities  during  the  past  two  years,  and  roughly  one-half  of  the  professional 
development  they  received  emphasized  elements  of  the  reform.  In  addition,  many  principals  and 
teachers  served  on  school  leadership  teams  responsible  for  implementing  changes  consistent  with 
the  reform.  Perhaps  as  a  result,  both  principals  and  teachers  believed  they  understood  the 
components  of  the  reform  well.  Moreover,  both  groups  were  generally  supportive  of  the  goals  of 
the  reform.  In  particular,  they  thought  the  goals  for  students  (“Students  will  think  analytically, 
logically  and  creatively....”)  were  attainable  and  the  standards  were  appropriate  for  the 
benchmark  grade  levels. 

In  addition  to  raising  awareness,  most  schools  have  taken  steps  to  align  their  local 
curriculum  and  instruction  with  the  EALRs.  Principals  and  teachers  believe  that  the  curriculum 
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was  well  aligned  in  the  subjects  of  reading,  writing,  and  mathematics,  the  subjects  tested  by 
WASL.  Alignment  was  proceeding  more  slowly  in  the  non-tested  subjects.  Some  schools  have 
gone  further  and  changed  policies  regarding  scheduling,  grading  and  student  retention.  A 
number  of  schools  increased  time  for  reading,  writing,  and/or  mathematics.  Almost  one-half  of 
the  elementary  schools  changed  their  report  card  format.  Additionally,  almost  one-half  of 
middle  schools  and  a  smaller  number  of  elementary  schools  instituted  student  grade-level 
retention  or  promotion  policies.  These  are  more  fundamental  changes  to  the  organizational  and 
incentive  structure  in  schools. 

Fourth  grade  teachers  and  seventh  grade  mathematics  and  writing  teachers  changed 
curriculum  content  and  instructional  strategies  to  promote  the  goals  of  the  reform.  In  writing, 
teachers  increased  their  coverage  of  genres,  style  appropriate  to  audience  and  purpose, 
development  of  concept  and  design  and  variety  of  forms.  Many  writing  teachers  changed  their 
teaching  strategies  as  well,  using  rubric-based  approaches  to  writing,  and  commenting  on  student 
writing  in  different  areas.  In  mathematics,  the  greatest  change  was  an  increase  in  coverage  of 
probability  and  statistics.  Mathematics  teachers  also  increased  their  attention  to  drawing 
conclusions  and  verifying  results,  investigating  situations,  and  organizing  and  interpreting 
information.  Since  the  reform,  more  mathematics  teachers  are  asking  open-response  questions 
with  many  right  answers,  having  students  explain  their  thinking  to  other  students,  and  having 
students  write  about  mathematics. 

Some  of  these  changes  were  in  response  to  the  EALRs  and  some  appear  to  be  direct 
responses  to  the  format  and  content  of  the  WASL  test.  For  example,  mathematics  teachers’ 
indicated  that  the  WASL  extended  response  and  short  answer  questions  were  very  influential, 
and  attention  to  WASL  may  explain  their  increased  emphasis  on  writing  about  mathematics  and 
asking  open  response  questions  with  many  right  answers.  In  writing,  teachers  increased  attention 
to  audience  and  purpose,  expanded  time  for  commenting  on  student  writing,  and  their  use  of  a 
mbric -based  approach  to  teaching  writing  may  also  be  a  result  of  the  testing  program. 
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However,  the  aforementioned  changes  were  not  large  in  magnitude.  In  most  cases,  teachers  were 
using  these  reform-oriented  strategies  “one  or  two  times  per  month”  when  they  previously  used 
them  much  less  often.  The  bulk  of  their  curriculum  and  instruction  appeared  to  be  much  as  it 
was  two  years  ago.  Writing  instruction  still  focuses  primarily  on  conventions  and  the  writing 
process.  Mathematics  instruction  still  emphasizes  number  sense. 

There  were  some  notable  difference  between  the  responses  of  principals  and  teachers. 
Principals  were  more  optimistic  about  the  status  of  implementation  than  were  teachers.  For 
example,  principals  were  more  positive  about  the  appropriateness  of  the  EALRs  and  the  WASL, 
as  well  as  the  attainability  of  the  overall  goals  of  the  reform  (see  Figure  20).  By  10  to  20 
percentage  points,  more  principals  reported  that  curriculum  in  their  schools  was  aligned  with  the 
EALRs  and  that  each  of  the  components  of  reform  promoted  better  instruction  and  increased 
student  learning.  There  are  a  number  of  possible  explanations  for  these  differences  of  opinion. 
They  may  reflect  the  fact  that  the  reform  is  being  implemented  in  a  top  down  manner  and 
principals  are  coming  to  understand  and  endorse  it  first.  They  may  reflect  the  reluctance  of 
teachers  to  change  and  the  resilience  of  classroom  practices  (see  for  example,  Cohen  et.al., 

1990).  Or  they  may  reflect  teachers’  clearer  understanding  of  the  demands  of  the  reform  at  the 
classroom  level. 

Survey  responses  also  show  differences  in  implementation  among  the  components  of  the 
reform.  In  particular,  teachers  were  attending  to  the  WASL  and  EALRs  more  than  the  other 
aspects  of  reform.  Most  educators  understood  the  EALRs  and  WASL  and  most  believed  that 
these  elements  of  reform  promoted  better  teaching  and  learning.  On  the  other  hand,  classroom- 
based  assessment,  in  particular,  was  not  as  well  understood  and  was  not  as  widely  implemented. 
This  may  be  due,  in  part,  to  the  fact  that  scores  from  classroom-based  assessment  were  not  used 
for  public  accountability.  Principals  also  reported  that  they  felt  less  pressure  for  their  students  to 
do  well  on  the  classroom-based  assessment  than  on  WASL  or  ITBS. 
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Figure  20 

Attitudes  Toward  Reform  Goals 

(percent  of  principals  and  teachers  who  strongly  agree  or  moderately  agree) 
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Classroom-based  assessment  was  intended  to  play  an  important  role  in  the  reform,  but  it 
appears  to  be  the  most  underdeveloped  component.  Classroom-based  assessment  is  designed  to 
help  teachers  understand  the  EALRs,  provide  coverage  of  EALRs  not  included  in  the  WASL, 
and  adapt  assessment  to  students'  needs  (Ensign,  1998).  However,  few  teachers  received 
professional  development  in  classroom-based  assessment,  and  few  teachers  understood  it  well. 
The  Commission  on  Student  Learning  developed  Assessment  Tool  Kits  to  support  classroom- 
based  assessment.  Although  principals  encouraged  teachers  to  obtain  Tool  Kit  training,  few 
have  participated,  and  only  a  handful  of  teachers  used  the  Tool  Kit  materials  in  preparing 
students  for  the  WASL.  Attitudes  toward  classroom-based  assessment  were  somewhat 
paradoxical.  Teachers  believed  that  better  classroom-based  assessment  would  lead  to  improved 
student  WASL  performance,  and  many  teachers  participated  on  local  committees  to  develop 
classroom-based  assessments.  However,  this  component  of  the  reform  was  not  widely 
implemented. 

Interestingly,  writing  teachers  seemed  to  be  having  an  easier  time  implementing  the 
reform  than  mathematics  teachers.  More  writing  teachers  than  mathematics  teachers  believed 
that  the  reform  led  to  better  teaching  and  learning,  that  the  WASL  tests  were  of  the  appropriate 
difficulty,  and  that  the  goals  of  the  reform  were  attainable.  More  writing  teachers  than 
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mathematics  teachers  found  their  professional  development  on  WASL  in  their  subject  area  to  be 
excellent.  Middle  school  writing  teachers  also  viewed  their  curriculum  as  more  aligned  with  the 
EALRs  than  did  middle  school  mathematics  teachers.  In  addition,  writing  teachers  were  more 
likely  to  report  that  the  education  reform  supported  the  changes  they  were  already  in  the  process 
of  making.  Writing  teachers  also  used  WASL  practice  items  more  frequently  than  mathematics 
teachers.  Mathematics  teachers,  in  contrast,  were  finding  the  reform  more  challenging.  One-half 
of  the  seventh  grade  mathematics  teachers  agreed  that  aligning  curriculum  with  EALRs  was 
difficult. 

A  few  grade  level  differences  were  detected,  most  notably  that  fewer  fourth  grade 
teachers  than  seventh  grade  teaches  found  the  WASL  to  be  appropriate  for  students  in  their  grade 
level.  Elementary  principals  and  teachers  were  more  supportive  of  classroom-based  assessment 
than  middle  school  educators.  In  writing,  more  seventh  grade  teachers  than  fourth  grade  teachers 
have  changed  their  writing  curriculum  and  teaching  strategies  in  the  last  two  years.  In 
mathematics,  just  the  opposite  was  true.  More  fourth  grade  teachers  than  seventh  grade  teachers 
made  changes  in  their  curriculum  and  pedagogy  in  the  last  two  years. 

Relationships  With  WASL  Scores 

The  WASL  tests  were  designed  to  measure  students’  mastery  of  the  EALRs,  and  WASL 
scores  should  be  influenced  by  the  actions  districts  and  schools  took  to  implement  the  education 
reform.  We  found  significant  positive  relationships  between  WASL  scores  and  curriculum 
alignment  (reported  by  teachers)  in  three  of  the  four  subjects.  Schools  in  which  teachers 
believed  their  classroom  curriculum  was  well  aligned  with  the  EALRs  had  higher  scores,  other 
things  being  equal,  than  schools  where  teachers  did  not  report  strong  alignment.  This  result 
indicates  that  “alignment”  is  more  than  just  a  catch-phrase;  it  is  an  important  element  in 
responding  to  the  Washington  reform.  Higher  reading  scores  were  also  found  for  schools  where 
more  teachers  reported  a  firm  understanding  of  the  EALRs  and  WASL.  This  suggests  a  way  that 
professional  development  can  play  an  important  role  in  preparing  teachers  to  implement  the 
reform. 
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Some  people  may  be  disappointed  that  so  many  of  the  other  variables  we  tested  were  not 
positively  related  to  WASL  scores.  Instead,  we  find  these  results  to  be  quite  heartening.  There 
are  three  reasons  for  our  optimism.  First,  it  is  quite  unusual  to  find  any  relationships  between 
aggregated  survey  measures  of  practice  and  aggregated  test  scores  at  the  school  level.  Our 
previous  research  in  Kentucky  failed  to  detect  any  relationships  between  survey  responses  and 
KIRIS  scores  or  KIRIS  gains  (Koretz,  1996;  Stecher  et  al.,  1998).  The  Washington  analyses 
compared  average  responses  from  teachers  to  average  scores  of  students,  and  the  survey  sample 
did  not  contain  all  teachers  in  all  schools.  Under  these  conditions,  few  significant  differences  are 
likely  to  be  found.  Second,  the  small  sample  size  gave  us  limited  power  to  detect  differences, 
and  pooling  data  from  elementary  and  middle  schools  may  have  further  clouded  some 
associations.  Finally,  the  fact  that  we  did  not  find  significant  effects  for  certain  variables  is  not 
conclusive  evidence  that  they  were  unimportant.  It  might  be  the  case  that  their  direct  impact  on 
WASL  was  not  strong  enough  to  be  detected  under  the  conditions  of  this  study,  but  they  may  still 
have  great  practical  importance. 

High  Stakes  Assessment 

The  high  stakes  associated  with  performance  on  the  WASL  led  to  other  changes  in 
practice  that  may  be  cause  for  concern.  Principals  reported  that  they  felt  a  great  deal  of  pressure 
for  their  students  to  do  well  on  the  WASL,  although  the  formal  accountability  system  is  still 
under  development.  The  same  pressure  that  leads  to  the  positive  changes  such  as  those  reported 
above  also  leads  to  potentially  deleterious  behaviors.  Responses  to  the  survey  suggested  that 
teachers  were  focusing  on  the  WASL  test  more  than  the  EALR,  were  shifting  instructional  time 
away  from  non-tested  subjects,  and  were  engaged  in  test  preparation  activities  that  may  reduce 
the  validity  of  WASL  scores. 

It  appears  that  changes  in  classroom  practice  were  focused  more  on  the  statewide  test 
than  the  standards  the  test  was  supposed  to  reflect,  i.e.,  more  on  the  WASL  than  the  EALRs. 
While  this  distinction  may  seem  minor  to  some,  it  is  very  important.  Each  WASL  test  samples 
only  a  fraction  of  the  domain  of  performance  described  in  the  EALRs.  Often  times  it  is  the  more 
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complex,  conceptual  or  integrated  aspects  of  the  domain  that  are  omitted  from  the  test  because 
they  are  difficult  to  measure  under  controlled  testing  situations.  Furthermore,  each  test  requires 
students  demonstrate  performance  in  a  limited  number  of  ways.  Thus  a  curriculum  that  was 
tailored  to  improve  test  performance  might  ignore  many  critical  aspects  of  the  adopted  standards. 
That  is  why  it  would  be  wrong  for  the  test  to  become  the  de  facto  standards.  However,  this 
substitution  of  test  specifications  and  format  for  standards-based  curriculum  has  been  observed 
in  other  states  with  high-stakes  test-based  accountability  systems.  There  is  evidence  that 
teachers  narrow  their  focus  to  the  tests  and  to  the  test  scoring  criteria  rather  than  the  domains  the 
tests  were  designed  to  assess  (Stecher  and  Mitchell,  1995;  Stecher,  1999).  There  is  some 
evidence  that  this  is  occurring  in  Washington,  and  care  should  be  taken  to  monitor  the  situation. 

Writing  provides  a  specific  example.  Last  year  a  task  force  convened  by  the  state 
recommended  a  change  to  the  WASL  test  in  writing  to  eliminate  uncertainty  about  which  genre 
would  be  tested.  Fourth  grade  was  assigned  narrative  and  expository  writing,  seventh  grade  was 
assigned  persuasive  writing  and  expository  writing,  and  tenth  grade  was  assigned  persuasive  and 
extended  expository  writing.  The  task  force  raised  the  concern  about  teachers’  narrowing  the 
writing  curriculum  to  focus  on  these  genres,  “This  action  is  in  no  way  meant  to  limit  classroom 
instruction  or  district  and  classroom-based  assessments.”  This  survey  occurred  before  the 
change  took  effect,  but  our  subsequent  survey  and  case  studies  may  be  able  to  address  whether 
the  writing  curriculum  has  narrowed  since  last  year. 

A  more  immediate  concern  is  a  reallocation  of  instructional  time  away  from  non-tested 
subjects.  Washington  adopted  standards  in  eight  subject  areas,  but  the  survey  shows  that  the 
amount  of  time  spent  on  the  WASL-tested  subjects  has  increased  over  the  last  two  years.  In 
many  cases,  schools  have  changed  their  schedules  to  increase  time  for  reading,  writing  and 
mathematics.  In  other  cases,  fourth  grade  teachers,  who  are  responsible  for  all  subjects  and  have 
some  flexibility  in  allocating  classroom  time,  have  focused  instruction  on  these  subjects.  They 
have  decreased  the  amount  of  time  spent  on  science,  listening,  arts,  and  health  and  fitness. 
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This  imbalance  in  subject  matter  emphasis  may  be  alleviated  as  the  state  introduces 
WASL  tests  in  science,  social  studies,  arts,  and  health  and  fitness  over  the  next  four  to  seven 
years.  However,  the  state  plans  to  introduce  these  tests  in  grades  other  than  the  benchmark 
grades  at  the  elementary  and  middle  school  levels  (OSPI,  2000,  March  27).  Similar  teacher 
surveys  in  Kentucky  revealed  that  curriculum  coverage  varied  significantly  from  one  grade  to  the 
next  in  parallel  with  the  subject  matter  emphasis  of  KIRIS  (Barron  and  Stecher,  1999).  For 
example,  students  in  fourth  and  seventh  grades  received  more  instruction  in  reading,  writing  and 
science,  while  students  in  fifth  and  eighth  grades  received  more  instruction  in  mathematics, 
social  studies,  and  arts/humanities.  Splitting  the  WASL  tests  between  two  grades  distributes  the 
testing  burden  on  a  single  grade  level,  and  it  also  creates  an  incentive  for  teachers  to  focus  their 
instruction  on  the  tested  subjects  at  the  expense  of  non-tested  subjects. 

The  emphasis  on  test  scores  had  led  to  an  increase  in  test  preparation  activities  that  may 
reduce  the  meaningfulness  of  the  WASL  results.  For  example,  teachers  were  increasing  their  use 
of  sample  test  items  and  WASL-like  questions  in  class.  By  focusing  narrowly  on  test 
preparation,  rather  than  mastery  of  the  standards,  teachers  may  increase  WASL  scores  without 
increasing  students’  broad  knowledge  of  the  EALRs.  This  is  a  complex  issue,  because  some 
kinds  of  test  familiarization  activities  are  quite  appropriate,  while  other  types  of  focused 
preparation  are  quite  inappropriate.  There  have  been  multiple  instances  recently  of  blatant 
cheating  on  statewide  tests  in  other  states.  The  strongest  evidence  that  concern  is  appropriate  in 
Washington  is  that  both  teachers  and  principals  agreed  that  test  preparation  was  responsible  for 
most  WASL  score  gains.  Similar  results  have  been  seen  in  other  states  with  high-stakes  testing 
programs  (Koretz,  et  al.  1996).  The  A+  Commission,  which  is  developing  a  formal 
accountability  mechanism  for  Washington,  would  be  wise  to  study  the  experience  of  other  states 
carefully. 

A  final  concern  is  the  overall  burden  that  testing  places  on  students  and  teachers.  The 
amount  of  state  testing  has  increased  with  the  implementation  of  WASL  and  the  second  grade 
reading  assessments,  and  it  will  continue  to  increase  over  the  next  seven  years  as  more  WASL 
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tests  become  operational.  Since  the  introduction  of  WASL,  rather  than  eliminate  extant  local 
assessments,  many  districts  have  added  or  revised  district  tests.  Thus,  the  overall  time  dedicated 
to  test  administration,  as  well  as  test  preparation,  is  increasing.  Concerns  about  testing  burden 
have  caused  state  legislatures  to  intervene  to  alter  the  testing  plans  in  other  states  (Chun  and 
Goertz,  1998).  Washington  should  be  careful  to  keep  testing  demands  manageable. 
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Appendix  B: 

Example  of  Essential  Academic  Learning  Requirements  in  Writing 


Appendix  C: 

List  of  Principal  and  Teacher  Survey  Items  Included  in  Regression  Model 

VARIABLE  I  QUESTION  WORDING  I  SCALE 


Per  Pupil  SLIG  Did  your  school  receive  Student  Learning  Dollar  amount  divided  by  total 

Expenditures  Improvement  Grants  (SLIG/LIAs)  for  in-service  enrollment 

training  or  formal  professional  development 
activities  this  school  year?  If  yes,  approximately 
how  much  SLIG/LIA  money  did  your  school 
spend  this  school  year  for  in-service  training  or 

_ formal  professional  development  activities? _ 

District  Standards  and  Currently,  how  well  do  your  district’s  standards  Do  not  have  standards 

Alignment  align  with  the  EARLs  in  each  subject  (reading.  Poorly  aligned 

writing,  mathematics,  communication)?  Somewhat  well  aligned 

_ Very  well  aligned _ 

Curriculum  Alignment  In  your  school,  how  well  does  the  current  Poorly  aligned 

curriculum  align  with  the  EALRs  in  the  Somewhat  well  aligned 

benchmark  grades  (grades  4  and  7;  in  reading,  Very  well  aligned 

_ writing,  mathematics,  communication)? _ 

School  Actions  Please  indicate  if  your  school  has  done  each  of  the  1  no;  2  yes 

following  in  reaction  to  WASL: 

1  held  staff  meetings  that  focus  on  WASL  issues; 

2  provided  release  time  for  teachers  to  prepare  for 
WASL; 

3  developed  a  school  plan  for  improving 
performance  on  WASL; 

4  implemented  test  preparation  activities  (e.g., 
example  tests); 

5  instituted  school  wide  policies  to  address 
curriculum  gaps  (e.g.,  use  of  Weekly  Reader,  “task 
of  the  week”; 

6  encouraged  teachers  to  obtain  assessment  Tool 
Kit  training; 

7  directed  Student  Learning  Improvement  Grant 
(SLIG/LIA)  funds  towards  WASL-related 
activities; 

8  provided  incentives  for  students  related  towards 
WASL  performance  (e.g.  parties,  fieldtrips); 

9  appealed  to  teachers’  and  students’  school  pride 
to  do  well  on  WASL; 

10  transferred  teachers  to  different  grades  or 
subjects; 

1 1  changed  report  card  format; 

12  implemented  schedule  changes  that  increased 
time  for  mathematics,  reading,  and/or  writing; 

13  had  teachers  or  school  leadership  team  take 
WASL  test  items; 

summer  school,  created  Saturday  school,  etc.); 

14  extended  instructional  hours  (e.g.  created  all¬ 
day  kindergarten,  instituted  15  created  homework 
clubs; 

16  instituted  a  student  grade-level  retention  or 
promotion  policy; 

17  held  cross-grade  meeting  of  teachers  to  discuss 
WASL  test  results. 
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Teacher  Surve 


Teacher  Experience 


Teacher  Understanding 
of  EALRs  and  WASL 


Curriculum  Alignment 


Professional 
Development  (WASL) 


Professional 
Development  (WA 
Reform) 


Test  Preparation  in 
Math 


Test  Preparation  in 
Writing 


Including  this  year,  how  many  years  have  you 
taught  on  a  full-time  basis:  In  any  location 
(including  other  states)? 


How  well  do  you  understand  each  of  the  following 
aspects  of  Washington’s  education  reform 
(Essential  learnings  and  benchmarks  (EALRs); 
Washington  student  assessment  (WASL))  ? 


How  well  is  your  current  curriculum  aligned  with 
the  EALRs  in  the  following  subjects  (reading, 
writing,  mathematics,  communication)? 


During  the  past  two  years,  how  much  of  your  in- 
service  training  or  formal  professional 
development  focused  on  the  following  topics 
(WASL  in  reading;  WASL  in  writing;  WASL  in 
mathematics;  WASL  in  listening)? 


During  the  past  two  school  years,  approximately 
how  many  hours  of  in-service  training  or  formal 
professional  development  did  you  participate  in? 
Of  these,  how  many  were  related  to  Washington’s 
education  reform? 


How  frequently  do  you  engage  in  each  of  the 
following  activities  to  help  students  do  well  on  the 
WASL  test  in  mathematics? 

1  Have  students  practice  using  items  released  from 
WASL  (e.g.,  Example  test,  Assessment  sampler); 

2  Discuss  responses  to  WASL  or  WASL-like 
items  that  illustrate  different  levels  of  performance 
(e.g.,  NCS  Mentor,  Example  test); 

3  Use  material  from  assessment  Tool  Kits; 

4  Have  students  score  classroom  work  using 
rubrics; 

5  Use  open-ended  questions  (short  answer  and 
extended  response)  in  classroom  work; 

6  Display  rubrics  in  classroom. 


How  frequently  do  you  engage  in  each  of  the 
following  activities  to  help  students  do  well  on  the 
WASL  test  in  writing? 

1  Have  students  practice  using  items  released  from 
WASL  (e.g..  Example  test,  Assessment  sampler); 

2  Discuss  responses  to  WASL  or  WASL-like 
items  that  illustrate  different  levels  of  performance 
(e.g.,  NCS  Mentor,  Example  test); 

3  Use  material  from  assessment  Tool  Kits; 

4  Have  students  score  classroom  work  using 
rubrics; 

5  Use  open-ended  questions  (short  answer  and 
extended  response)  in  classroom  work; 

6  Display  rubrics  in  classroom; 

7  Teach  Six-Trait  or  other  rubric-based  approach 
to  writing. 


Number  of  years 


Do  not  understand 
Understand  somewhat 
Understand  well 
Understand  very  well 


I  do  not  teach  this  subject; 
Poorly  aligned 
Somewhat  well  aligned 
Very  well  aligned 


None 

A  small  amount 
A  moderate  amount 
A  great  deal 


Number  of  hours 


Never  (zero  times  per  year) 

1-2  times  per  semester  (about  1- 
5  times  per  year); 

1-2  times  per  month  (about  6-30 
times  per  year); 

1-2  times  per  week  (about  31-80 
times  per  year); 

Almost  daily  (more  than  80 
times  per  year) 


Never  (zero  times  per  year) 

1-2  times  per  semester  (about  1- 
5  times  per  year); 

1-2  times  per  month  (about  6-30 
times  per  year); 

1-2  times  per  week  (about  31-80 
times  per  year); 

Almost  daily  (more  than  80 
times  per  year) 
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Appendix  D 

Results  of  Regression  Analyses  of  WASL  Scores  on  Selected  Survey  Responses 


Table  D.l 

Variable  Means  and  Standard  Deviations 

VARIABLE 

DESCRIPTION 

MEAN 

SD 

Percent  Free/Reduced  Price  Lunch 

Percent  of  students  receiving  free 
or  reduced  price  lunch 

37.83 

22.50 

Percent  Asian 

Percent  Asian  students 

5.70 

7.09 

Percent  American  Indian 

Percent  American  Indian  students 

3.85 

6.76 

Percent  Black 

Percent  Black  students 

3.98 

6.73 

Percent  Hispanic 

Percent  Hispanic  students 

10.92 

17.98 

Percent  White 

Percent  White  students 

75.54 

22.32 

Percent  Female 

Percent  Female  students 

48.19 

2.14 

Enrollment 

Total  school  enrollment 

486.26 

203.92 

Principal  Survey 

SLIG  Expenditures 

Amount  of  SLIG  money  per  pupil 

25.05 

District  Standards  and  Alignment 

Existence  of  district  standards  in 

13.56 

2.58 

the  four  WASL-tested  subjects  and 
alignment  with  EALRs  in  each 
subject 

Curriculum  Alignment 

Degree  of  curriculum  alignment  in 
the  four  WASL-tested  subjects 

9.57 

2.10 

School  Actions 

Sum  of  17  actions  possibly  taken 
in  response  to  the  WASL 

10.98 

2.39 

Teacher  Survey 

Teacher  Experience 

Total  number  of  years  of 
experience 

15.74 

7.98 

Teacher  Understanding  of  EALRs  & 

Understanding  of  the  EALRs  and 

6.33 

0.94 

WASL 

Curriculum  Alignment 

the  WASL 

Degree  of  curriculum  alignment  in 

10.50 

2.40 

the  four  WASL  subjects 

Degree  to  which  professional 
development  activities  focused  on 
the  WASL  in  the  four  tested 
subjects 

8.76 

2.26 

Professional  Development  (WASL) 

Professional  Development  (WA  Reform) 

Number  of  hours  of  professional 
development  that  focused  on 
Washington’s  education  reform 

31.56 

26.71 

Test  Preparation  in  Math 

Frequency  of  6  WASL 
mathematics  preparation  activities 

16.82 

4.19 

Test  Preparation  in  Writing 

Frequency  of  7  WASL  writing 
preparation  activities 

20.43 

4.50 

WASL  Scores 

School-level  WASL  scores  for  4“ 
and  7th  graders,  pooled 

Mathematics 

370.90 

21.55 

Writing 

363.15 

19.13 

Reading 

397.02 

8.99 

Listening 

425.87 

21.71 
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Table  D.2 

Regression  of  WASL  Scores  on  Student  and  School  Factors,  Statewide 


Math 

Writing 

Reading 

Listening 

Student  and  School 
Factors 

P 

Sig. 

P 

Sig. 

P 

Sig. 

P 

Sig. 

Percent  Free/Reduced 

-.015 

.000 

-.020 

.000 

mid 

.000 

-.018 

.000 

Price  Lunch 

Percent  Asian 

.019 

.000 

.024 

.000 

.017 

.000 

-.003 

.312 

Percent  American  Indian 

-.022 

.000 

-.022 

.000 

-.021 

.000 

-.011 

.000 

Percent  Black 

-.018 

.000 

-.013 

.000 

-.015 

.000 

-.020 

.000 

Percent  Hispanic 

-.012 

.000 

-.007 

.000 

-.013 

.000 

-.013 

.000 

Percent  Female 

.007 

.377 

.030 

.000 

.004 

.642 

.016 

.036 

Enrollment 

-.0005 

.000 

.0003 

.004 

-.001 

.000 

.0003 

.005 

N 

1401 

1401 

1401 

1401 

R2 

.31 

.44 

.34 

.41 

Table  D.3 

Regression  of  WASL  Scores  on  Principal  and  Teacher  Survey  Responses 


Variables 

Math 

p  Sig. 

Writing 

P  Sig. 

Reading 

P  Sig • 

Listening 

p  Sis- 

Percent  Free/Reduced 

-.022 

wmm 

mmm 

wmm 

-.025 

.000 

-.018 

.007 

Price  Lunch 

Percent  Asian 

-.007 

.689 

.007 

.679 

-.0003 

.986 

.004 

.845 

Percent  American  Indian 

-.016 

.251 

-.023 

.093 

-.012 

.335 

-.009 

.530 

Percent  Black 

.001 

.958 

.001 

.956 

.008 

.633 

-.003 

.894 

Percent  Hispanic 

.005 

.496 

.005 

.488 

.006 

.331 

-.013 

.072 

Percent  Female 

.009 

.818 

.021 

.592 

.007 

.850 

.076 

.077 

Enrollment 

-.0002 

.656 

.001 

.215 

-.0004 

.334 

-.0004 

.487 

Principal  Survey 

Amount  of  SLIG  money 

-.005 

.420 

-.004 

.491 

.001 

.927 

.011 

.124 

Existence  of  District 

.020 

.683 

-.040 

.417 

.042 

.359 

-.002 

.963 

Standards 

Curriculum  Alignment 

.033 

.561 

.056 

.335 

.018 

.731 

.034 

.588 

#  of  School  Actions  in 

.041 

.290 

.025 

.514 

.049 

.172 

.006 

.890 

Response  to  WASL 

Teacher  Survey 

Teacher  Experience 

.022 

.023 

.011 

.287 

-.003 

.790 

Test  Preparation  in  Math 

.047 

.066 

.049 

.055 

.060 

.011 

.001 

.977 

Test  Preparation  in  Writing 

-.025 

.311 

-.045 

.074 

-.010 

.647 

-.020 

.469 

Teacher  Understanding  of 

.279 

.010 

.162 

.130 

.193 

.051 

-.143 

.219 

EALRs  and  WASL 

Curriculum  Alignment 

.138 

.000 

-.017 

.650 

.169 

.000 

-.180 

.000 

Professional  Development 

-.016 

.699 

.005 

.902 

.007 

.874 

.062 

.171 

(WASL) 

Professional  Development 

-.005 

.103 

-.006 

.050 

-.008 

.010 

.002 

.509 

(WA  Reform) 

N 

83 

83 

83 

83 

R2 

.655 

.564 

.719 

.600 
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